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A  warninq  level  alert  -  a  display  indi¬ 
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to  an  intruding  aircraft.  Corrective, 
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response. 

A  derived  quantity  usually  expressed  in 
seconds,  which  represents  the  time  *n  the 
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Warninq  Alert  -  Emerqency  operational  or  aircraft  system 

conditions  that,  require  immediate 
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Workload  -  A  relative  term  indicat.inq  the  amount  of 
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1.0  INTRODUCTION  ANO  BACKGROUND 


In  mid-lQftl  the  Federal  Aviation  Admini stration  announced  the  details  of  an 
ai rhorne-hased  collision  avoidance  system  in  a  technical  workino  symposium 
sponsored  by  the  aqency.  The  Traffic  Alert  and  Collision  Avoidance  System 
(TCAS!  was  described  in  tWo  levels  of  sophistication.  The  simplest  level, 

TCAS  I,  alerts  the  pilot  of  proximity  of  another  aircraft  with  a  visual  and/or 
aural  alert.  This  system  is  directed  primarily  toward  providinq  somp  protec¬ 
tion  fnr  smaller  aircraft.  The  TCAS  II  svstem  on  the  other  hand  is  desiqnpd 
for  larqer  aircraft  and  has  a  hinher  sophistication  and  cost.  The  capabilities 
that  have  been  attributed  *o  the  TCAS  II  system  include; 

0  "It  will  have  the  ability  to  transmit  to  others  (TCAS  I  and  TCAS 
II  equipped  aircraftl  traffic  advisory  information  (ranoe, 
hearinq,  differential  altitude,  at>ove/below  information!. 

o  It  will  provide  collision  avoidance  protection  independenti y  from 
the  qround  ATC  svstem  usinq  vertical  maneuvers,  wifh  potentia1 
expansion  to  horizontal  maneuvers  should  technical  and  economic 
feasibility  be  demonstrated . 

o  Like  TCAS  I,  it  will  have  an  integral  transponder  capable  of 
resoondinq  on  Modes  A,  C  and  s. 

0  TCAS  IT  v/ill  provide  alert  and  advisory  information  to  *hp 

aircraft  equipn°d  only  wi*h  TCAS  I,  while  in  the  casp  of  two 
aircraft  equipped  with  TCAS  H,  coordinated  advisories  would  be 
prov i ded . "  (11. 

As  was  pointed  out  in  the  symposium,  much  of  the  technolooy  associated  with 
the  TCAS  II  system  was  developed  under  the  earlier  Beacon  Collision  Avoidance 
System  (RCAS)  proqram.  The  technolooy  discussed  was  primarily  s°nsor  and 
software  based  providinq  a  detailed  description  nf  how  the  svs+em  will 
qenerate  information  about  other  aircraft. .  nf  equal  importance  to  the  overall 
operation  of  the  systppi,  however,  is  the  presentation  of  this  information  to 
the  crow  in  such  a  way  fhat  it  can  be  used  effectively  in  an  operational 
ai  rcraft. . 
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As  was  pointed  out  "it  is  difficult,  to  evaluate  even  a  limited  array  of 
dismay  devices  in  ooerational  aircraft,  and  it  is  similarly  difficult  tp 
perform  comprehensi ve  workload  analyses  nee  the  variety  of  flight  sceneries 
is  necessarily  limited  hy  safety  considerations."  It  was  therefore  planned  to 
answer  these  ouestions  in  simulator  studies. 

In  Auaust  IdAl,  the  Roeinq  Comerclai  Airplane  Company,  Crew  Systems  Prouo  was 
awarded  a  contract  by  t^e  FAA  for  the  ourpose  of  assistino  in  the  determina¬ 
tion  of  flight  dec1'  display  requirements  for  operational  implementation  of  the 
TCAS  II  system  in  commercial  transport  aircraft.  The  nroaram  is  a  two  phase 
effort,  the  Developmental  Simulation  and  the  Operational  Simulation.  Thp 
first  phase  comhined  a  number  of  resolution  advisory  as  well  as  traffic 
advisory  display  concepts  with  an  integrated  crew  alertino  system  to  be  evalu¬ 
ated  for  effectiveness  by  Covernment ,  industry  and  line  pilots.  The  second 
phase  will  have  primarily  line  qualified  fliqht  crews  exercise  the  TCAS  T1 
system  in  a  fully  certified  operational  transport  trainino  simulator  in  order 
fo  determine  the  proper  operating  procedures,  identify  workload  imnart , 
validate  the  display  system  and  in  oeneral  oive  the  system  an  operational 
"shakedown"  prior  to  enterinn  the  TCA^  operational  evaluation  fliqht  tost 
phase . 

Since  the  transfer  of  information  t.o  the  crow  in  a  timely  manner  about  an 
abnormal  situation  is  t*o  definition  of  an  alert,  the  cornerstone  of  any 
display  concept  for  TCAS  should  ho  the  voluntary  guidelines  on  alert-inn 
systems  issued  by  thp  FA A  in  lb01  (?).  Those  Guidelines  were  a  culmination  gf 
seven  years  of  research  sponsored  by  the  FAA  and  directed  toward  the  improve¬ 
ment  and  standardization  of  flight  dpek  alerting  systems.  This  work  began  by 
studyina  concepts  for  an  independent  altitude  monitor  fQl  for  the  reduction  of 
inadvertent  terrain  impact  alerts.  It  was  then  expanded  to  consider  the 
alerting  problem  as  a  whole  and  to  loot  at  conventional  flight  deck  alertino 
methods.  The  findings  from  these  studies  fi, A, FI  revealed  that  there  had  been 
a  significant  increase  in  the  amount  of  information  being  Dro$enteH  to  the 
crew  and  that  very  little  effort  haH  been  expended  in  attempting  to 
standardize  this  information.  Pilots  were  viewing  crew  alerting  as  a  nuisance 
rather  than  a  help.  In  a  \Q77  report  (Fi  Cooper  stated  that  "caution  and 
warning  systems  w°ro  originally  installed  a?  a  reasonable  means  of  assisting 
pilots  t.o  maintain  safe,  reliable,  economical  system  operation  in  the  face  of 
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hiqh  workloads.  However,  the*:*  systems,  intended  t.o  reduce  hazards,  are 
themselves  becominq  hazards.  The  vast  increase  in  the  ntimher  of  alerts  and 
the  frequent,  occurrence  of  false  or  nuisance  alerts  impose  h»avy  demands  on 
the  aircrew.  More  alerts  require  more  memori zaHon '  hiaher  workloads,  and 
could  induce  a  hiqher  probability  of  error." 

The  alertinq  system  quidelines  which  were  produced  throuqh  a  ioint  effort  bv 
the  Boeinq,  Lockheed  and  McDonnell  Douqlas  Aircraft  Companies,  describe  in 
detail  the  recommendations  for  presentation  of  aler+s  of  anv  urqencv  ( see 
Fiqure  1.0-11.  From  the  research  conducted  durino  this  prooram  a  set.  of 
warnino  level  alerts  were  identified  that,  were  defined  as  "time-critical." 

The  report  (?)  describes  the  alertinq  methods  and  media  for  presentino  the 
time-critical  warninqs.  This  is  relevant  to  the  present  prooram  because 

one  of  the  warninos  identified  as  fittinc  into  the  time-critical  catenory  was 
the  collision  avoidance  al°rt.  Therefore,  in  selectino  +he  display  character¬ 
istics  to  bp  tested  in  the  developmental  simulation  it  was  necessary  to  review 
the  crew  alertinq  data  base  and  select  those  characteri sties  most  likely  to 
provide  the  most  effective  information  transfer.  The  literature,  test  results 
and  pilot's  subjective  input  were  used  to  identify  the  can'ii'iatp  TCAs  TT 
display  concept. 

1.1  Report  Hrnanization 

Section  ?  of  this  report  contains  an  executive  summary  of  the  major  activities 
and  findinqs  of  the  pevel opmentai  Simulation  test.inq  effort.  genera1 
description  of  the  t.pst  facility  is  presented  in  Section  1.  The  methodol ooy , 
equipment,  and  results  of  the  testina  are  discussed  in  Section  4.  Discussions 
of  the  maior  findinqs  and  the  conclusions  drawn  from  these  data  may  he  found 
in  Section  S  and  Section  S  describes  the  objectives  of  the  next  study  nhase. 

The  Appendices  at  the  end  of  this  report  describe  in  detail  the  test  facility. 
Also  included  are  the  questionnaire  tha+  were  used  to  obtain  pilot  innut  for 
i nenrporation  into  the  display  concept. 


3 


Condition 

Criteria 

Alert  system  characteristics 

Visual 

Aural 

Tactile 

Warning 

Emergency  operational  or  aircraft 
system  conditions  that  require 
immediate  corrective  or 
compensatory  crew  action 

Master  visual  (red) 
plus  centrally  located 
alphanumeric 
readout  (red) 

Unique 

attention- 

getting 

warning 

sound 

plus  voice* 

Stick 

shaker 

(if 

required) 

Caution 

Abnormal  operational  or  aircraft 
system  conditions  that  require 
immediate  crew  awareness  and 
require  prompt  corrective  or 
compensatory  crew  action 

Master  visual  (amber) 

plus  centrally  located 

alphanumeric 

readout 

(amber) 

Unique 

attention- 

getting 

caution 

sound 

plus  voice* 

None 

Advisory 

Operational  or  aircraft  system 
conditions  drat  require  crew 
awareness  and  mav  require 
crew  action 

Centrally  located 
alphanumeric 
readout 
(unique  color) 

Unique 

attention- 

getting 

advisory 

sound 

None 

Information 

Operational  or  aircraft  system 
conditions  that  require  cockpit 
indications,  but  not  necessarily 
as  part  of  the  integrated 
warning  system 

Discrete  indication 
(green  and  white) 

None 

None 

•Voice  is  pilot  selectable. 


Figure  1.0- 1.  Guidelines  for  Standardizing  Alerting  Functions  and  Methods 
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?.n  EXECUTIVE  SUMMARY 


?.l  Program  Rackoround 

In  Auqust  1QR1  The  Rowing  Commercial  Airplane  ComDany  beqan  a  nroaram  spon¬ 
sored  by  the  FAA  for  the  ourpose  of  assisting  in  the  determination  of  flight 
deck  display  requirements  and  operational  procedures  for  the  implementation  of 
the  TCAS  II  system  in  commercial  transport  aircraft.  After  initial  meetings 
which  established  the  overall  objectives,  around  rules  and  a  schedule  of 
activities,  candidate  display  concepts  for  the  developmental  simulation  were 
formulated.  Since  the  collision  avoidance  situation  must  be  announced  to  the 
crew,  the  work  that  has  been  done  in  crew  alerting  was  used  as  a  basis  for 
selection  of  disolay  characteristics,  format,  location  and  combinations.  The 
resolution  advisory  was  classified  as  a  time-critical  alert  and  treated  as 
such  when  ident.ifyinn  presentation  methods  and  information  contents. 

Reference  materia1  was  established  and  disolay  combinations  identified. 

The  maior  obiec.tives  of  the  developmental  simulation  were:  to  evaluate  the 
alerting  effectiveness  of  the  candidate  TEAS  display  system  concepts;  to 
evaluate  display  sophi stir ation  with  respect  to  different  levels  of  flight 
deck  sophistication;  to  determine  thp  viability  of  including  a  caution  level 
alert  known  as  a  traffic  advisory  (TA1  prior  to  presenting  the  resolution 
advisory  ( RA 1 :  to  idnntir  the  minimum  information  requirements  for  the  RA  and 
TA;  and  to  recommend  a  TEAS  disolay  concept-  to  he  used  in  future  tes+ing 
phas°s . 

?.?  Poyel  opment.al  Simulation  Testinq 

The  TEAS  displays  and  a  rudimentary  set  of  algorithms  were  implemented  ip  the 
Visual  Flight  Simulation  Facility.  Thirteen  qualified  transport,  pilots  with 
an  average  of  *1,100  hours  flight  experience,  participated  in  the  test.  Each 
flew  fifteen  test,  flights  of  thirty-one  minutes  in  length  and  was  nresented  a 
total  of  ??S  alerting  situations. 
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To  simulate  a  flioht  deck  environment  and  work  pattern,  a  realistic  aircraft 
model  was  used  for  the  basic  flyinq  task.  In  addition,  the  pilots  were 
required  to  fly  a  prescribed  flioht  dan  (takeoff,  climb,  cruise,  descent  and 
landinqs),  respond  t.n  ATC  directives,  locate  and  report,  traffic  in  the 
external  visual  scene  and  resoond  to  the  alerts. 

The  variables  investiqated  in  the  test  include: 

o  Resolution  Advisory  Display  -  I  VST  plus  voice,  LED  plus  voice,  or 
voice  alone. 

o  Traffic  Advisory  Display  -  none,  TCAC  liqht,  CRT  tabular  without 
boqrino,  CRT  tahu^r  with  hearinq,  CRT  current  oraphic  or  CRT 
advanced  qraphics. 

o  Percent  of  encounters  not  oroceedino  to  3  resolution  advisory  -  IW 
or  50* 

The  results  of  this  test  are  summarized  hpi  nw  and  describe  in  detail  in 
Section  4. 

Since  any  collision  avoidance  warninq  (RAT  can  he  defined  as  a  timp-cri tiral 
alert,  the  primary  desion  concerns  when  consider! no  the  display  system  to  be 
used  are  the  speed  and  accuracy  of  the  response.  The  time  takPn  by  the  pilots 
to  detect  an  alert  or  a  cbanqe  in  the  urgency  level  of  an  a1  err.  is  directly 
related  to  the  time  tahen  to  respond  to  the  alerts.  Of  *he  three  basic  alert 
combinations,  the  initial  detection  of  a  rpa  light  in  the  primary  field  of 
view  and  a  warninq  sound  (siren)  was  sionificant.lv  faster  than  an  amber  lioht 
in  the  primary  field  of  view  and  an  advisory  sound  (cbimpl  which  was,  in  turn, 
si qni fi cant! v  faster  than  a  CRT  presentation  in  the  secondary  field  of  view 
and  an  advisory  sound  (chime).  These  findinqs  suoqpst  that  the  master  liaht 
in  the  primary  fieTd  of  view  does  aid  detection  but  more  imoort.ant  is  the  t.ypp 
of  sound  used  for  the  master  aural  .  Detectino  a  chanoe  in  uroency  IpvpI  is 
also  dependent  on  the  alertinq  s°oupnrp.  The  resolution  advisory  (warninq) 
was  detected  fastest  when  it.  was  preceded  by  the  caution  level  TCAS  liaht. 

This  detection  time  was  siqni ficantl y  shorter  than  the  time  when  therp  was  no 
caution  at  all  and  the  time  ohtained  usinq  the  CRT  for  the  caution  alerts.  No 
measurahle  difference  was  found  hetween  the  latter  two  conditions. 
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The  performance  data  1  nrticat.es  that  both  the  ore!  imi nary  alert  (caution)  in¬ 
formation  and  the  time-critical  display  have  an  effect  on  the  response  t.o  the 
resolution  advisory  (warnino).  A  direct  relationship  was  found  between 
response  time  and  detection  time.  The  lonoer  it  took  a  pilot  to  detect  the 
resolution  advisory  the  slower  the  response  performance.  The  typp  of 
resolution  advisory  display  used  also  had  an  effect  on  performance.  The 
modified  IVSI  display  combined  with  a  voice  alert  resulted  in  the  fastest 
responses  and  the  voice  display  when  used  alone  resulted  in  the  slowest. 

fven  t.houah  system  reliability  was  not  a  specific  variable  in  the  objective 
test,  when  questioned  ahout  the  implementation  of  TCAS  (see  debrief inn 
questionnaire  Aooendix  0)  seventy-five  percent  of  the  pilots  tested  felt  that 
the  system  should  he  required  on  aircraft  as  soon  as  it  can  he  demonstrated  to 
perform  reliably.  This  opinion  was  not  hased  solely  on  the  conf iquration  used 
in  testinq  since  seventy-five  percent,  (not  necessarily  the  same  Pilots  as 
above)  of  the  pilots  were  familiar  with  TCAS  before  oart.ici oati no  in  the  test. 
This  interest  in  system  reliability  was  expressed  in  the  answers  to  a  number 
of  other  questions. 

with  respect  t.o  the  major  system  components,  (master  alerts,  traffic 
advisories,  and  resolution  advisories)  the  pilots  had  the  foliowina  opinions: 

o  Master  Alerts 

Both  master  aural  and  master  visual  alprts  should  be  uspd  to  o°t 
the  crew's  attention  under  all  conditions. 

Three  levels  of  tau-hased  alerts  were  too  many  and  two  level  5 
Were  recommended,  caution  (TA)  and  warnina  (RA1. 

0  Traffic  Advisory 

All  the  pilots  felt  that  some  form  of  caution  alert  was  needed 

Opinion  was  split  between  usino  a  TCAS  liqht  or  a  CRT  traffic 
information  display  for  the  caution  level  information  (TA). 
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After  each  pilot  had  used  the  CRT  traffic  display  In  RA 
encounters,  sixty-seven  percent  responded  to  a  Question  con- 
cernino  Its  affect  on  outside  visual  scan  by  indlcat.lna  that 
pilots  with  an  automated  traffic  advisory  display  could  become 
complacent  in  scannina  especially  for  non- transponder  equipped 
aircraft.  Since  the  test  bad  no  intruders  without,  transponders, 
the  basis  of  this  concern  lies  in  the  pilots'  ooerational  experi¬ 
ence  and  possibly  on  the  newness  of  the  display.  However,  it 
does  point  to  an  area  for  further  testinq. 

If  a  CRT  traffic  information  display  is  included  as  part  of  the 
system,  it  should  present,  the  information  Graphically  usinq  color 
for  urqency  level.  It  should  display  no  more  than  T  aircraft 
simultaneously.  Traffic  presented  on  the  display  should  include 
bearina  data,  horizontal  separation  (both  ranqe  and  t.i me 1  and 
altitude  relative  to  the  own  aircraft. 

Resolution  Advisory 

Ninety-two  percent  of  the  pilots  listen  corrective  Guidance 
alerts  ( cl imb/descent.l  as  a  necessary  portion  of  TCAS.  Since  no 
preventive  alerts  (don't,  climb/don't  descend!  were  tested  in  the 
simulation,  the  pilots  were  less  sure  that  these  should  he 
included  as  a  necessary  part  of  the  system. 

An  arrow  was  selected  as  the  appropriate  method  for  present.inq 
climb  and  descend  quidance. 

Vertical  speed  should  be  included  on  the  resolution  advisory 
di splay. 

Bars  or  indexes  associated  with  the  vertical  sneed  should  be  used 
to  impose  limits. 

The  modified  IVSI  was  the  display  of  choice  for  thp  pilots 
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?.R  Candidate  System  Description 


The  final  effort  of  the  developmental  simulation  was  the  recommendation  of  a 
traffic  and  resolution  advisory  display  combination  and  component  character¬ 
istics  of  the  displays  for  the  subsequent  phases  of  the  proaram  and  flinht. 
verification.  Because  the  objective  of  TCAS  displays  is  to  qet.  the  crew's 
attention  and  provide  them  with  information,  the  recommended  configuration 
closely  followed  Hie  guidelines  set  forth  by  the  FAA  for  the  standardization 
of  crew  alerting  systems. 

Since  the  TCAS  information  can  be  classified  as  alerts,  the  displays  should 
perform  the  functions  attributed  to  the  alertina  system  which  are; 

o  Attract  the  attention  of  the  crew  and  direct  that  attention  to  the 
alertina  condition  so  that  corrective  action  can  be  taken. 

o  Inform  the  flinht  crew  of  the  location  and  nature  of  t.he  alertina 
condition.  Sufficient,  information  should  he  provided  to  enable  the 
crew  to  initiate  timely,  corrective  action. 

o  Provide  t.he  crew  feedback  on  the  adenuacv  of  their  corrective  action. 

o  Provide  the  crew  with  a  mer.hani  smf  si  to  control  the  system  to  enable 

them  to  assess  aircraft  status  quickly,  and  to  identify  new  alerts. 

The  need  for  each  of  these  functions  was  identified  hy  Cooper  (SI,  Roucek, 
Erickson,  Person,  Hanson,  Leffler,  and  Po-Chedlpy  'Bl,  and  in  ARP-Asnn  0*11. 
The  manner  in  which  these  basic  functions  are  implemented  will  determine  the 
effectiveness  of  the  alertina  system.  ARP-flSOO  states  that  "safety  of  flinht 
is  qreatly  enhanced  bv  an  alert.inq  system  desinned  to  provide  early  crew 
recognition  of  flinht.  crew  operational  error,  as  well  as  aircraft  system  or 
component,  status  or  malfunctions".  For  example,  the  system  should  attract,  the 
crew's  attention  to  an  alertinq  situation,  hut.  should  not  hp  so  disruptive 
that  it  deqrades  other  crew  task  performance,  information  processing,  or  t.he 
deci si on-maki nq  required  to  take  corrective  actions.  The  ouidelines  for 
designing  these  hasic  functions  arp  described  in  the  Aircraft  Alerting  Systems 
Standardization  Study  (?). 
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To  accomplish  these  functions  the  foil  owl  no  components  should  h*  provided: 
o  Traffic  Advisory 

A  unique  sound  and  amher  Hqht  on  the  alareshield  should  he  used  as  a 
caution  level  Indication, 
o  Resolution  Advisory 

A  unique  warninq  sound  and  red  liqht  on  the  qlareshieid  should 
he  used  to  attract  the  crew's  attention. 

Visual  resolution  advisory  disDlay  providinq  quidance  usinq 
arrows  for  vertical  maneuvers  and  indexes  associated  with 
vertical  speed  for  limits. 

Voice  alert,  with  information  equivalent,  to  the  visual  display 
and  continuous  until  cancelled. 

o  Traffic  Information  Display 

Before  a  CRT  display  can  hp  recommended  as  a  necessary  system 
componpnt,  further  tostinq  should  he  conducted  with  the  tragic 
information  display  to  assess  its  imoact  on  system  operation. 

Display  should  provide  a  color  coded  (hv  alert  level  1  aranhic 
presentation  of  the  traffic  information  includinq  at  least 
hearinq,  altitude,  horizontal  separation  and  vertical  direction 
i  nformat.i  on . 

?.4  Follow-on  Verification  and  Evaluation 

Phase  II  of  the  study,  the  Operational  Simulation,  will  implement  the  concept 
TCAS  II  display  system  in  simulation  harHware  and  install  it  into  a  motion 
Oase  cab  with  full  operational  capability.  The  appropriate  TCAS  softwar°  will 
he  implemented  to  provide  fidelity  to  fhe  alertinq  situations  and  to  make  the 
findings  more  general izahle  to  actual  operations. 
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3.0  TEST  FACILITY 


The  various  study  requirements  dictated  the  use  of  a  facility  in  which  a 
fliqht.  deck  system  could  he  integrated,  tested  and  evaluated  in  a  simulated 
environment.  This  facility  consists  essentially  of  a  qeneric  cah  that  serves 
as  an  "operational  breadboard"  to  facilitate  the  development  of  flight  deck 
system  concents,  functional  capabilities,  and  interface  features.  Proposed 
systems,  system  chanaes,  and  alternative  mechanizations  can  he  evaluated  and 
demonstrated  in  such  a  facility.  It.  also  provides  a  flexihle  experimental 
simulation  laboratory  that  allows  for  easy  introduction  of  new  hardware  and 
change  to  the  flight  deck  system  confiouration.  System  software  is  modulariz¬ 
ed  to  facilitate  chanae;  interface  equipment  is  flexible  and  thus  allows  for 
wide  varieties  of  enqinpering  developmental  evaluations.  These  elements  have 
been  designed  into  the  Boeing  Company  Kent  Fliqht  Simulation  Center.  See 
figures  3.0-1  for  an  illustration  of  these  facilities.  For  more  detailed 
descriptions  refer  to  Appendix  A, 
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Figure  3.0.1 .  Kent  Visual  Flight  Simulation  Center 
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4.D  DEVELOPMENTAL  SIMULATION  -  TEST  DESCRIPTION  AMn  RESULTS 


The  primary  ournose  of  ♦'Up  Developmental  Simii"1  at.ion  tps+ipc  phase  was  to 
evaluate  thp  t  q  AS  information  renuirpments  and  develop  a  s°+  of  functional 
recoronendati ons  for  thp  necessary  displays.  Thp  followinq  sections  win 
describe  in  detail  thp  simulation  tost  performed  to  achiovp  thpsp  ooal s  and 
thp  rpsolts  ohtainpd. 

4. 1  Test  OhiPcti vps 

The  TCAS  developmental  test  was  desioned  to  evaluate  information  nrpsontation 
on  both  the  Resolution  Advisory  (RAi  display  a  pH  thp  traffic  advisory  f  TA  > 
display  and  identify  minimum  information  recommendations.  Thp  test  was 
desioned  to  examine  the  followinn  experimental  questions  concernino  the 
presentati on  of  TCAS  information: 

1.  Does  a  caution  level  alert  have  any  effect  on  the  response  performance 
*•0  thp  resolution  advisory? 

?.  How  much  information  is  nepded  to  make  a  caution  level  alert  effective? 

3.  Is  there  any  difference  in  the  use  of  the  traffic  information  display 
when  the  alerts  are  presented  oranhically  or  al pha-numericall v? 

4.  Does  the  response  to  the  resolution  advisory  rhanop  as  a  function  of 
different  display  combinations  and  formats? 


S.  Does  the  type  of  resolution  advisory  display  have  an  effect  on  resnonsp 
performance7 

h.  Can  the  pilots  use  thp  information  on  the  traffic  display  to  anti ci Date 
the  resolution  advisory7 

7 .  Does  the  certainty  of  the  occurance  of  a  warninq  have  an  effect  on 
response  or  defection  performance7 
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fl.  Is  alert  detection  affected  hy  Hi  splay  combinations’ 

Q.  Do  the  display  combinations  have  any  differential  effect  on  the  way  a 

pilot  responds  to  the  alert? 

in.  What  information  is  needed  for  the  resolution  advisory’’ 

11 .  What  information  would  thp  pilots  like  to  see  on  the  traffic  information 

Hi spl ay? 

4.?  Experimental  Oesiqn 
4.7.1  Test  Hesiqn 

The  basic  experimental  Hesiqn  for  the  developmental  simulation  was  a  factorial 
analyses  of  variance  with  repeated  measures  on  at  least  onp  of  the  variables. 
The  Hesiqn  of  the  test  was  chosen  to  evaluate  the  effectiveness  of  different 
combinations  of  TEAS  display  types  in  elicitinq  an  accurate  and  rapid 
response  from  the  pilots.  The  test  confi qurat.i on  is  presented  in  Fiqurp 
4.?.  1-1.  There  were  three  independent  variables  for  the  test.:  a)  PA  displav 
format  b)  TA  display  format  and  c)  percent,  of  the  encounters  which  did  not  pro¬ 
ceed  to  an  RA.  The  RA  display  variable  had  t.hrpp  levels;  A  modified  vortical 
sp°ed  indicator  comhined  with  voice,  an  LED  presentation  combi  nod  with  voice 
and  a  voice  presentation  without  any  visua1s.  The  traffic  disnlay  was  pre¬ 
sented  in  six  formats:  no  traffic  display  at  ail,  an  amhpr  TEAS  lioht,  a  EOT 
tabular  presentation  of  the  rpnap  and  altitude  of  the  int.riidpr  aircraft,  a  ERT 
tabular  nresentation  of  the  ranoe,  altitude  and  hearinq  of  the  intruder  and 
two  different.  rPT  qraphic  presentations  of  the  in+ruder  posifion.  Finally, 
the  percopt  of  the  encounters  which  proceeded  to  an  RA  was  pither  ho  or  Se 
percent . 

Time  and  resources  did  not  permit  thp  administration  of  all  treatment 
combinations  tp  every  pilot;  therefore,  the  test  was  administered  as  illustrat¬ 
ed  in  Fiqure  4. ?. 1-1  in  two  different  factorial  desions,  a  ?  x  6  (oprcent 
non-RA  encounters  x  Traffic  display  format.!  dpsiqn  with  pilots  nested  within 
the  encounter  variable  and  a  7  x  T  x  4  (percent  non-RA  display  format  x  TA 
display  format!  desiqn,  also  with  pilots  nested  within  the  encounter  variable 
and  repeated  measures  on  the  other  variables. 


14 


TRAFFIC 
DISPLAY  (TA) 


Figure  4.2.1 -1 .  Developmental  Simulation  Test  Design 


Fiqure  4. 2. 1-2  Illustrates  the  arrangement  of  the  alert.inq  comoonents  used  in 
the  test.  Each  display  combination  tested  consisted  of  three  hasic  components, 
the  master  alerts,  the  traffic  alert  and  the  resolution  advisory.  A  split.- 
leqend  master  visual  alert  was  located  in  the  pilot's  primary  field  of  vision, 
on  the  qlareshield.  The  upper  half  of  the  master  alert  was  red  and  labelled 
WARMING;  the  lower  half  was  amber  and  labelled  CAUTION.  The  master  aural 
.Herts  were  presented  over  a  dedicated  speaker  located  to  the  pilot's  left. 

Tho  sounds  used  for  the  alert  levels  were  consistent  with  those  recommended  in 
the  literature  (21  and  can  he  described  as  follows: 

WARNING  (RA)  A  sound  characteri zed  as  a  European  police  siren.  This  sound 
consisted  of  two  tones  (hiqh  fifth  Hz  and  low  Tin  Hzl  which 
alternated  back  and  forth  at  a  rate  of  two  times  a  second. 

CAIJT T ON  (TA)  A  steady  sound  consistina  of  two  frequencies,  7fin  Hz  and  Apn 
Hz.  The  sound  was  present  for  2  seconds  and  then  repeated 
every  If)  seconds  until  it  was  cancelled  or  the  alert  went  awav. 

ADVISORY  (pa)  A  sinqle  stroke  chime.  A  47S  Hz  tone  was  Dresented  with  a  cn 
milliseconds  rise  and  a  1.R  second  decay  in  intensity. 

The  peak  intensity  level  for  the  tones  werp  adjusted  to  approximately  HB 
which  was  R  dB  above  the  averaqe  ambient  noise  in  the  simulator.  The 
si  qnal  -  to-noi  se  ratio  was  held  constant,  by  an  automatic  gain  control  . 

The  traffic  advisories  were  presented  on  either  an  amher  TCAS  liqht  located  on 
the  qlareshield  or  on  one  of  the  two  CRT's  located  forward  of  the  throttles. 

The  CRT  displays  presented  the  location  of  the  intruder  aircraft  either  in  an 
al nhanumeric  (tabular)  form  or  a  graphic  form. 

Two  disnlavs  were  used  to  visually  produce  the  RA  alert.  A  vertical  speed 
indicator  which  had  been  modified  by  adding  directional  arrows  and  limit  bars 
(See  Fiqure  4.2.1 -T)  was  located  below  the  altimeter.  An  LFD  display  which 
provided  directional  and  limit  nuidance  both  graphically  and  al phanumericall v 
(see  Fioure  4. 7.1 -4)  was  located  to  the  left  of  the  Horizontal  Situation 
Indicator.  A  voice  display  was  also  used  to  present  *he  RA  alerts.  The  voice 
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Figure  4.2. 1-4.  Developmental  Simulation  LED  Display  Formats 


t 


messaqes  came  from  the  dedicated  alertlnq  speaker  and  were  preceded  hy  a  n.75 
second  presentation  of  the  warnlnq  sound.  The  voice  message  was  repeated 
until  the  pilot  physically  cancelled  it  or  performed  the  correct  maneuver. 

Therefore,  the  sequence  of  events  that  occurred  for  each  alertino  situation 
which  went,  to  an  RA  is  as  follows: 

TAU  =  45  seconds  PA  LEVEL  ALERT  -  Chime  sounds  and  deDendinq 

on  fhe  test  conditions  either  the  TCAS  liqht 
or  the  CRT  is  activated  with  blue  codinq  (no 
alert  is  qiven  at  the  level  if  it  is  an  RA 
only  trial 1 . 

TAU  =  35  seconds  TA  LEVEL  ALERT  -  C-chord  sounds  master 

caution  or  the  TCAS  lioht  illuminates  if  the 
CRT  is  heinq  used  the  information  concernino 
the  TA  level  intruder  turns  amher  (no  alert, 
is  qiven  at  this  level  it  it  is  an  RA  only 
trial ) . 

TAU  =  25  seconds  RA  LEVEL  ALERT  -  European  siren  sounds,  t.hp 

red  master  warnino  liqht.  illuminates,  the 
CRT  (if  used!  information  for  the  RA 
intruder  chanoes  red  and  the  appropriate  RA 
displays  activate  (dependinq  on  the  test 
condi  tionl  with  t.hp  Guidance  messaoe. 

All  of  the  variables  were  chosen  to  evaluate  the  effectiveness  of  the  system 
in  alert.inq  rapid  and  accurate  responses.  Therefore,  the  selection  of  each 
variable  had  as  a  basis  the  amount  and  t.vn°  of  information  presented  to  the 
pilot,  about  t.he  intruder  aircraft  and  subsequent  evasive  action.  The 
rationale  for  selectinq  the  display  types,  display  formats  and  non-RA 
encounter  variables  are  described  below. 
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The  traffic  display  served  to  provide  t.he  pilot  wi  t.h  a  caution  IpvpI  alert 
which  prepared  him  for  the  RA.  The  format  of  this  "lower"  level  alert  is  in 
question.  If  the  alert  were  simply  a  "GET  REAny"  for  the  RA,  then  a  liaht 
•  ould  s°rvp  this  purpose.  If  on  the  other  hand  t.h°  pilots  could  use  informa¬ 
tion  about,  the  location  and  approach  of  the  intruder  to  increase  their 
r.onfi donee  in  the  RA  or  anticipate  *he  direction  of  the  command  maneuver  t-hop 
a  more  complex  alert  would  he  appropriate.  Therefore,  each  of  *hp  traffic 
display  formats  wpre  chosen  because  they  either  provided  more  information  or 
they  presented  the  information  differently.  The  tabular  format  orovidina 
altitude  and  ranqe  (Fiqure  4. 2.1. El  nave  the  pilot  some  indication  of  the 
intruder  flight  path  hut  di ri  pot  pinpoint,  the  location.  The  addition  of 
hearing  information  to  the  tabular  format  (Figure  4. 2.1. El  supnplied  more 
information  to  the  pilot,  but  that  information  had  to  he  accurately  converted 
to  a  snatial  representation.  The  two  graphic  formats  (Figures  4. 2. 1-7  and  -^1 
presented  this  information,  and  also  provided  at  least  a  p1 an  view  of  the 
spatial  relationship.  Finally,  a  recorded  version  of  ATT  +raffic  advisories 
were  presented  on  one  flight  for  each  pilot  to  provide  a  baseline  condition  in 
the  test. 

The  second  variable  to  be  i nvesti gated  was  the  tvne  of  RA  display.  Three 
methods  of  presentation  were  investigated  in  which  the  pilot  must  receive  the 
alert,  understand  it,  and  act  on  it  in  a  very  short  period  of  time.  The 
modifieH  I  VS  I  had  the  advantage  of  integrating  vertical  guidance  with  the 
instrument  used  to  display  the  vprtical  sp°pd  of  the  aircraft.  This  instru¬ 
ment  was  also  compatible  with  currently  used  i nstrumentation.  Though  the  dis¬ 
play  is  located  in  the  pilots'  primary  field  of  vision  (1E°  from  centerlinel 
in  the  head  down  position,  it.  is  not  whpn  the  pilot  is  head  up.  Also  it  was 
fe't  that  the  ^rranqpment  of  lights  on  the  display  may  cause  confusion, 
especially  for  those  alert'-  which  reauire  a  specified  climh  rate.  The  LED 
display  presented  graphically  and  al nhanumericall v  all  the  ra  guidance.  It 
was  located  on  the  main  instrument  panel,  howeypr,  it  could  he  located  on  the 
alareshield  where  it  would  be  in  t.he  pilot's  primary  field  vision  both  head 
up  and  head  down.  Finally,  the  voice  display  was  not  affected  by  t.he 
Hirertiep  o f  the  pilot's  vision. 
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Figure  4.2. 1-5. 

Tabular  Threat  Display 

-  Without  Bearing 
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Figure  4.2. 1-6.  Tabular  Threat  Display— With  Bearing 


Figure  4.2. 1-7.  Currently  Used  Graphic  Format 


Note  Predictor  (dashed  line)  is  broken  in  three  segments  representing 

distances  traveled  in  10  sec.  If  the  total  distance  is  too  short,  then 
a  solid  line  is  used. 


Figure  4.2. 1-8.  Advanced  Graphic  Format 


The  third  variable  under  consideration  was  the  frequency  in  which  a  threat,  at 
the  caution  level  (TA)  became  a  warninq  (RA).  In  t.he  operational  sense  it.  is 
expected  that  because  of  its  flight  path,  an  aircraft  could  trigqer  a  traffic 
advisory  and  not  an  evasive  maneuver.  The  question  to  be  answered  was  that  if 
this  situation  occurs  often  will  the  pilots  respond  the  same  to  the  resolution 
advisories  when  they  do  occur’  To  answer  the  question,  the  traffic  advisories 
progressing  to  resolution  advisories  was  tested  at  either  AO  or  do  percent  of 
the  time. 

4.2.?  Intruder  Flight  Path 

In  order  to  make  the  TCAS  alprtino  situations  realistic  and  to  provide  a 
variety  of  displayed  information,  a  number  of  different  fliqht  paths  were 
developed  for  the  intruder  aircraft.  These  flioht  paths  can  be  classified 
into  four  qeneral  categories  (see  Fiqure  4.2.2.11.  The  first  category 
consisted  of  intruders  flying  on  an  intercept  course  with  a  difference  in 
altitude  of  500  to  1500  feet  either  above  or  below  the  own  aircraft.  This 
cateqory  was  called  altitude  offset.  The  second  cateaory,  known  as 
longitudinal  offset,  called  for  the  intruder  to  fly  at  the  same  altitude  as 
thp  own  aircraft  on  a  course  that,  would  take  it  .25  to  .50  mile  pitber  to  t^e 
front  or  to  the  rear.  The  third  category  called  for  the  intruder  to  be 
climhinq  or  descending  into  the  own  aircraft.  This  maneuver  may  or  may  not  be 
accomoanied  by  either  altitude  or  lonqitudinal  offset..  This  cateqory  was 
referred  to  as  chanqinq  altitude  fliqht  paths.  Finally,  the  own  aircraft  was 
faced  with  more  than  one  intruder.  The  intruders  werp  the  same  altitude  as 
the  own  aircraft,  and  on  an  intercept,  course.  They  could  he  either  both  at  the 
same  anqle  of  arrival  or  have  widely  different,  anqles.  This  cateqory  was 
known  as  the  multiple  intruder. 

4.2.3  Simulation  TCAS  Loqic 

A  much  simplified  set  of  loqic  was  used  to  activate  the  TCAS  disnlays.  This 
was  possible  because  the  obiective  of  the  test  was  to  study  the  pilots 
response  to  the  displays  in  a  systematic  manner  rather  than  t.o  test  the  full 
TCAS  system  and  orovide  a  definitive  work  on  the  operational  procedures. 
Therefore,  the  intruder  aircraft  flew  canned  fliqht  paths  which  activated  thp 
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Figure  42.2 -  J.  Intrusion  Scenarios 


dl  sol  ays  In  t.he  followinq  manner:  A  proximate  advisory  (PA)  activated  when 
the  intruder  was  45  seconds  from  the  point  of  closest  approach  (also  known  as 
TAU).  The  traffic  advisory  (TA)  or  caution  alert  activated  when  TAU  reached 
3F  seconds.  Finally,  the  resolution  advisory  (RAl  or  warninq  alert  activated 
when  TAU  reached  25  seconds.  The  direction  of  the  RA  vertical  quidance  was 
always  away  from  the  intruder  with  the  smallest  TAll  value.  The  vertical  ratp 
limits  were  imposed  durinq  fliqht  seqments  in  which  the  nominal  fliqht.  path 
called  for  a  climb  or  descent  profile.  The  limits  were  consistent  with  the 
expected  vertical  speed.  The  correct  response  to  any  vertical  alert,  was  .25(1 
(3  foot  per  second  squared)  vertical  maneuver  in  the  appropriate  direction.  A 
Chanqe  in  vertical  speed  which  exceeded  the  correct  msponse  maneuver  termi¬ 
nated  the  alert. 

4.3  Pilot  Sample 

Thirteen  pilots  with  a  wide  ranqe  of  experience,  includinq  line  pilots, 
instructors,  and  manaqement  pilots,  participated  in  thp  developmental  simula¬ 
tion  tests  at  the  Boeinq  facility.  The  qrouD  consisted  of  representatives 
from  Boeinq,  from  domestic  airlines  includinq  American,  Rpnublic,  United,  U. 

S.  Air,  and  Western,  from  FAA,  and  from  NASA.  A  summary  of  the  oilot  experi¬ 
ence  is  presented  in  Table  4.3-1;  numerical  pntries  on  the  riqht  hand  side  of 
the  tahle  indicate  the  specific  experience  by  aircraft  type  and  recency  of  t.he 
experience  (A  is  most  recent). 

a. 4  Crew  Tasks 

4.4.1  Fliaht.  Task 

To  simulate  the  fliqht  deck  environment  and  work  pattern,  the  pilots  performed 
test  fliqhts  of  31  minut°s  duration  in  the  simulator.  An  aircraft,  model  was 
used  for  the  basic  flyinq  task;  the  pilots  were  required  to  fly  a  prescribed 
fliqht  plan,  respond  to  ATC  communications,  locate  tarqets  in  an  external 
visual  scene  and  respond  to  alerts.  The  fliqht  instrumentation  available  to 
the  pilots  to  perform  their  tasks,  shown  in  Fiqure  4. 4.1-1,  consisted  of  an 
airspeed  indicator;  an  electronic  attitude  director  indicator  (EADT-roll, 
pitch,  qlideslope);  an  altimeter;  a  rate  of  climb  indicator;  a  horizontal 
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Table  4.3- 1.  Summary  of  Pilot  Experience 


Statistic 

Pilot  experience 

Specific  aircraft  experience 

Age 

TCA's 

past 

year 

Flight- 

hours 

(1.000) 

Recency* 

707 

727 

737 

747 

DC-8 

DC-9 

DC  10 

L  1011 

Other 

Mean 

43.4 

190 

9.1 

ifjg 

D 

5 

2 

fl 

B 

2 

2 

Standard 

deviation 

D 

209 

n 

B 

■ 

2 

3 

B 

i 

1 

1 

3 

Range 

37  0 

to 

51  0 

4.0 

to 

1 7.0 

C 

3 

3 

B 

fl 

B 

2 

D 

B 

B 

B 

B 

B 

i 

■ 

fl! 

| 

'  A  is  the  most  recent  aircraft  flown. 


Pilot  affiliation 

•  FAA 

3 

•  ATA 

3 

•  NASA 

1 

•  ALPA 

3 

•  Boeing 

2 

•  APA 

1 
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Figure  4.4. 1-1.  Flight  Deck 


situation  indicator  (HSI-cnurse,  OME,  localizerl;  the  pilot's  time-critical 
display;  and  a  clock  to  indicate  fliqht  time.  The  center  panel  contained  t.he 
visual  information  display,  the  electronic  »nqine  instrument  display,  flaps 
indicator  and  qear  liqhts. 

The  fliqht  controls  available  to  the  pilot  included:  wheel  and  column  with 
trim;  rudder  and  toe  brakes;  speed  brakes;  flap  handle;  ciQar  handle;  fire 
handles;  throttle;  response  key  matrix;  and  a  1?  key  input  panel. 

The  tests  flioht.  plan  is  i 1 l  ustrated  in  Fiqure  4.4.1-?.  It  was  divided  into 
five  flioht  phases:  takeoff,  climb,  cruise,  descent  and  landino.  The  pilot 
performed  a  visual  takeoff  (figure  a. 4. 1-"?)  on  a  headinn  of  ?fin°  at  a  rate  of 
climb  resulting  from  T  Ac.  of  ?10  knots.  The  outside  visual  scene  disappeared 
after  takeoff.  To  achieve  a  more  controlled  flight  path  for  t.he  flights,  the 
auto  throttle  was  enaaqeH  at  ?non  feet  and  flew  the  prescribed  speorl  profile 
for  the  remainder  of  the  flight.  The  pilot  leveled  off  and  held  1  SHOD  feet 
t.hrouqh  turns  1,  ?  and  1.  At  a  point  10  miles  from  waypoint  D  he  received  an 
ATC  clearance  t.o  descend  to  10,000  feet.  After  executing  turn  ATT.  cleared 
the  aircraft  t.o  TOno  feet..  At.  9.5  miles  he  was  further  cleared  for  TLS 
approach  and  landing.  The  qlideslope  raw  data  box  appeared  on  the  r.Ani.  At 
one  mile  and  T50  feet  t.he  visual  scene  was  aoain  presented  for  landing.  The 
ATC  clearances  associated  with  the  fliqht  plan  are  presented  ip  Table  4. 4. 1-1. 

4.4.?  System  Alert  Response  Tasks 

When  the  pilots  detected  a  system  ai°rt,  thpy  were  required  t.o  dppross  a 
button  located  on  the  left,  side  of  the  control  wheel.  This  action  was  us°d  to 
mark  the  time  that  the  pilot  pprceived  the  new  alert..  After  identifying  the 
specific  alert,  the  pilot,  performed  a  prescribed  response  t.0  solve  the 
problem.  Table  4.4.7-1  presents  the  operational  or  system  conditions  that 
were  used,  alonq  with  their  associated  responses.  As  can  he  seen,  the 
responses  were  divided  between  two  categories,  those  that  were  made  with 
operable  system  elements  (e.g.,  wbpel  back,  cycle  gear,  etc.!  and  those  that 
were  made  through  a  response  panel  by  depressing  the  switch  corresponding  to 
t.he  system  which  had  a  problem  fp.g.,  L  SYS  HYO  PRESR,  ANTI-ICE).  The  response 
panel  had  18  switches  located  in  thp  center  aisle  stand,  and  configured  as 
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Figure  4.4. 1-2.  Developmental  Simulation  Fhghtpath 
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Table  4.4. 1-1.  A  TC  Communication 


Distance 

Altitude 

ATC 

1 

0 

0 

Boeing  101:  Pinevalley  Tower:  cleared  for  takeoff 
runway  36,  wind  calm  altimeter  29.92.  Cleared 
left  heading  310  deg  at  fix  ALPHA,  Monitor 
Pinevalley  Approach  Control  348.2  after  takeoff. 

2 

21.7  nmi 

15,000 

Boeing  101:  Pinevalley  Approach  Control:  fix 
COCOA,  turn  left  heading  242  maintain  15,000. 

3 

29.3  nmi 

15,000 

Boeing  101:  Pinevalley  Approach  Control:  fix 
COCOA,  turn  left  heading  169  maintain  15,000. 

4 

71  nmi 

15,000 

Boeing  101:  Pinevalley  Approach  Control: 
descend  to  10,000,  cleared  penetration  and 

1 LS  approach  runway  36. 

5 

90.8  nmi 

10,000 

Boeing  101:  Pinevalley  Approach  Control:  have 
you  starting  approach,  do  not  descend  below 

4,000  feet  until  DME  9.5  nmi,  current  winds 
light  and  variable  altimeter  29.92,  monitor 

Pinevalley  Tower  253.8. 

6 

112.3  nmi 

4,000 

Boeing  101:  Pinevalley  Tower:  cleared  to  land 
runway  36. 
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Table  4.4.2- 1.  Operational  and  System  Conditions  for  Alerts  and  Their  Associated  Response 


Alert 

Alert 

code 

CRT  message 

Urgency 

level*5 

Pilot's  response 

Flight 

engineer's 

response 

Left  engine  fire 

8 

L  ENG  FIRE 

W 

PULL  LEFT  FIRE  HANDLE 

RF  FIRE* 

APU  fire 

9 

APU  FIRE 

W 

PULL  CENTER  FIRE  HANDLE 

RP  FIRE 

Flaps  set  improperly 

10 

TAKEOFF  FLAPS 

W 

CYCL E  FLAP  HANDLE 

RP  CONFIG 

Flaps  set  improperly 

15 

LANDING  FLAPS 

W 

CYCLE  FLAP  HANDLE 

RP  CONFIG 

Right  engine  failure 

11 

R  ENG  FAIL 

W 

RP  ENG  STATUS 

RP  ENG  STATUS 

Gear  not  down 

12 

GEAR  NOT  DOWN 

W 

CYCLE  GEAR  HANDLE 

RP  GEAR 

Overspeed 

13 

OVERSPEED 

W 

THROTTLEBACK 

RP  OVRSPD 

Cabin  altitude 

14 

CABIN  ALT 

w 

COLUMN  FORWARD 

RP  CABN  ALT 

Left  generator  drive  oil 

16 

GEN  DRIVE  OIL 

c 

RP  ELEC 

DISCONNECT 

GENERATOR 

Gear  disagree 

17 

GEAR  DISAGREE 

c 

RP  GEAR 

RP  GEAR 

Right  system 
hydraulic  pressure 

18 

R  SYS  HYD  PRSR 

c 

RP  HYD 

CYCLE  RIGHT 

HYDRAULIC 

SYSTEM 

Antiskid  inoperative 

19 

ANTI-SKID  INOP 

c 

RP  ANTI  SKID 

RP  ANTI  SKID 

Left  air-conditioning 
pack  trip  off 

20 

L  PACK  TRIP 

c 

RP  ECS 

RP  ECS 

Forward  main  door  open 

21 

FWD  MAIN  DOOR 

c 

RP  DOOR 

RP  DOOR 

Right  engine 
oil  pressure  low 

22 

R  ENG  OIL  PRSR 

c 

RP  ENG  STATUS 

RP  ENG  STATUS 

Anti-ice  inoperative 

23 

ANTI-ICE 

c 

RP  ANTI-ICE 

RP  ANTI-ICE 

Autospoiler  inoperative 

24 

AUTO-SPOILER 

c 

RP  AUTO-SPLR 

- 

Altitude  alert 

25 

ALTITUDE 

c 

RP  ALT 

RP  ALT  ALRT 

Left  bleed  off 

26 

L  BLEED  OFF 

A 

RP  ECS 

RP  ECS 

Galley  bus  off 

27 

GLY  BUS  OFF 

A 

RP  ELEC 

CYCLE  SWITCH 

Utility  bus  off 

28 

UTIL  BUS  OFF 

A 

RP  ELEC 

CYCLE  SWITCH 

Right  engine 
hydraulic  pump 

29 

R  ENG  HYD  PUMP 

A 

RP  HYD 

CYCLE  SWITCH 

Left  engine 
fire  detector 

30 

L  ENG  FIRE  DET 

A 

RP  FIRE 

RP  FIRE 

Left  brake  overheat 

31 

L  BRAKE  OVHT 

A 

RP  BRK 

RP  BRK 

Right  forward 
fuel  pump 

32 

R  FWD  FUEL  PUMP 

A 

RP  FUEL 

CYCLE  SWITCH 

Forward  cabin  call 

33 

FWD  CABIN  CALL 

A 

RP  CABN  CALL 

RP  CABN  CALL 

SELCAL 

34 

SELCAL 

A 

RP SELCAL 

RP SELCAL 

aRP  =  response  panel 

**W  =  warning  C  =  caution  A  =  advisory 
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Table  4.4. 2-1.  Operational  and  System  Conditions  for  Alerts  and  Their  Associated  Responses  ( Concluded ) 


Alert 

Alert 

code 

CRT  message 

Urgency 

level 

Pilot's  response 

Flight 

Engineer's 

response 

Upper  yaw  damper 
failure 

35 

UPPER  YD  FAIL 

B 

RPFLTCONTRL 

RPFLTCONTRL 

Leading  edge  flaps 

36 

LE  FLAPS 

RPFLTCONTRL 

RPFLTCONTRL 

Air-conditioning 

pressure 

37 

AIRCOND/PRSR 

H 

RP  ECS 

RP  ECS 

Left  generator  off 

38 

L  GEN  OFF 

■  1 

RP  ELEC 

CYCLE  SWITCH 

Left  bus  tie 

39 

L  BUS  TIE 

RP  ELEC 

CYCLE  SWITCH 

Right  electric 
hydraulic  pump 

41 

R  ELEC  HYDPUMP 

n 

RP  HYD 

CYCLE  SWITCH 

Autothrottle  disconnect 

43 

A/T  DISC 

D 

RP  A/T 

RP  A/T 

34 


T 

seen  in  Fiqure  4. 4. 2-1.  Caution  and  advisory  level  alerts  were  always 
responded  to  throuqh  this  panel.  When  the  pilot,  made  t.he  correct,  response, 
the  alert  messaqe  was  removed  from  the  screen,  the  master  visual  alert,  was 
extinouished  and  the  aural  alerts  were  silenced. 

4.4.3  TCAS  Alert  Response  Task 

When  the  pilots  detected  a  TCAS  alert  they  responded  hy  pressinq  the  button  on 
the  left  hand  side  of  the  control  wheel.  This  action  marked  when  the  alerts 
were  detected.  They  were  also  required  to  respond  with  this  button  each  time 
the  alert  chanqed  urqency  levels,  i.e.,  advisory  to  caution  or  caution  to 
warninq.  For  those  encounters  in  which  the  intruder  aircraft  was  visible,  the 
pilot  was  also  asked  to  push  the  riqht  hand  button  when  he  had  identified  the 
aircraft.  After  the  alert  had  proceeded  to  the  resolution  advisory  alert  the 
pilot  performed  the  maneuver  that  was  displayed.  They  were  instructed  to 
achieve  approximately  a  .25G  climb  or  descent  to  an  excursion  of  lono  feet  per 
minute  on  the  IVSI.  When  the  pilot  made  the  correct  response  (i.e.,  aircraft 
achieved  .25G  vertical  acceleration  in  the  correct  direction),  the  alert  was 
discontinued.  A  second  type  of  resolution  advisory  was  also  possible.  This 
alert  type  called  for  the  pilots  to  limit  a  vertical  maneuver  that  they  were 
already  performinq.  Examples  of  the  two  types  of  alerts  are  presented  in 
Fiqure  4. 4. 3-1. 

4.5  Test  Procedures 

The  variables  tested  in  the  developmental  simulation  are  described  in  section 
4.2.1.  All  variables  not  tested  were  held  constant  or  controlled  to  avoid 
hiasinq  or  confoundinq  the  results.  Simulated  aircraft  ambient  noise  with  an 
averaqe  intensity  of  approximately  7D  dB  was  presented  durinq  the  fliqht.  task 
to  mask  the  uncontrolled  noise  that  may  have  been  occurrinq  around  the  cab. 

The  ambient  noise  was  controlled  by  throttle  position  and  airspeed  to  provide 
a  realistic  sound  spectrum  based  on  aircraft  performance.  Durinq  each  fliqht, 
variations  of  the  noise  level  were  kept  within  the  ranqe  of  fi7dB  and  72dB. 

The  ambient  liqht  levels  were  kept,  very  low  (5  ft-L)  to  permit  the  use  of  the 
outside  visual  scene.  ATC  communications  were  presented  at  75dB  and  held 
constant  for  all  trails;  visual  messaqe  contrast,  was  also  held  constant  for 
all  trials.  All  pilots  received  t.he  same  instructions  to  minimize  experimenter 
bias  (see  Appendix  B). 
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Figure  4.4.2- 1.  Pitot’s  Response  Pane / 


36 


•CLIMB 

DESCEND 


•Limit  climb  to  500  ft/min 
Limit  climb  to  1 .000  ft/min 
Limit  climb  to  2.000  ft/min 
Limit  descent  to  500  ft/min 
Limit  descent  to  1 ,000  ft/min 
Limit  descent  to  2,000  ft/min 


Displayed  alert. 

e  4. 4. 3-1.  TCAS  Resolution  Advisory  Alerts  and  Example  IVSI  Presentation 


Each  test  fliqht  was  11  minutes  in  lenqth  and  contained  IS  alerts:  twelve  TCAS 
intrusions  and  three  system  alerts.  This  number  of  alerts  is  not  indicative 
of  the  number  expected  in  actual  system  operation.  A  larqpr  than  expected 

number  of  alerts  were  chosen  for  the  simple  reason  that  to  obtain  a  sufficient 

amount  of  data  with  realistic  time  periods  between  the  resolution  advisories 
would  have  required  testinq  time  far  in  excess  of  the  scope  for  the  study. 

The  effect  on  the  data  of  usinq  a  hiqher  rate  of  alert  occurences  was  to 
reduce  somewhat  the  surprise  and  uncertainty  factors,  thus  makinq  the  response 

and  detection  times  shorter  than  would  be  expected  in  actual  operation.  These 

times  were  also  affected  by  the  fact  that  the  pilots  knew  that  it.  was  a  TCAS 
test  and  were  expectino  the  alerts.  Therefore,  the  times  ohtained  for  the 
test  cannot,  be  directly  applied  to  opera'. ional  situations.  This  does  not, 
however,  mean  that  the  data  cannot  be  used.  Since  all  display  combinations 
were  used  with  the  same  number  of  alerts,  the  relative  differences  in  time 
between  these  combinations  do  aive  an  indication  of  the  information  transfer 
occurrinq  with  the  displays.  This  kind  of  result  meets  the  objectives  of  the 
test.  Therefore  the  number  of  alerts  combi  nod  with  a  rplatn/elv  hiqh  workload 
to  keep  the  pilots  involved  in  flyino  do  provide  aoproptia^p  information  in  a 
cost  effective  manner.  The  alerts  were  presented  on  a  schedule  of  two  minute 
intervals;  however,  to  help  prevent  the  pilot's  anticipation  of  the  alerts,  a 
AS  second  interval  around  each  two  minute  mark  was  allocated  for  thp  alorts. 
The  alerts  could  therefore  be  presented  as  clos°  toqethpr  as  3n  seconds.  Thp 
times  were  chosen  at  random,  and  l?  different  time  scenarios  wore  developed. 
The  only  restriction  on  the  time  selection  was  that,  no  alert  could  occur  after 
30  minutes  into  the  fliqht  to  permit  the  pilot,  at  least  SO  seconds  to  respond 
to  the  last  alert.  To  reducp  thp  possibility  of  influencinq  the  data  by  the 
order  in  which  the  alerts  were  presented,  \?  random  alert  orderinns  werp 
developed  and  combined  at  random  with  the  time  scenarios  to  produce  the  test 
scenarios . 

Whenever  task  pprformance  is  measurpd  under  spvpral  differpnt  treatment 
conditions  over  an  extended  period  of  time,  learninq  or  fat.ique  may  affpct 
performancp  on  later  trials.  Care  was  taken  to  dpsiqn  an  appropriate 
counterbalancing  scheme  to  prevent  carry-over  effects  from  differentially 
affpctinq  t.hp  performance  measures  for  the  different  treatment,  conditions.  It 
should  he  noted,  therefore,  that  the  order  in  which  thp  pilot  received  t.he 
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experimental  treatments  was  also  randomly  assiqned  to  prevent  order  bias  from 
confoundinq  the  results  (see  Table  4.R-1).  Immediately  prior  to  each  flight 
the  pilot  was  briefed  on  the  alertinq  system  confiquration  that  he  would  be 
uslnq. 

The  dally  test  schedule  for  the  developmental  simulation  tests  is  presented  in 
Table  4.5-?;  all  pilots  were  to  fly  only  one  non-encounter  condition.  Two 
pilots  were  tested  each  week  spendinq  two  days  per  pilot  in  the  simulation. 

The  test  participation  beqan  with  an  introduction  to  the  Visual  Fliqht 
Simulation  Facility  and  a  review  of  the  proqram.  The  pilots  were  briefed  on 
the  fliqht  plan  and  qiven  the  nominal  fliqht  path  parameters  (see  Fiqure 
4.4.1.?).  They  were  encouraqed  to  take  notes  on  their  brief inn  sheet  and  to 
use  them  durinq  fliqht.  Following  the  hriefinq,  the  pilots  entered  the  cab 
for  instruction  on  the  operational  characteristics  of  the  simulator  and  the 
test  fliqht  tasks  (see  Apnendix  R  for  the  hriefina  checklist). 

The  pilots  were  informed  of  the  basic  tasks  to  be  carried  out.  durino  each 
fliqht.  The  first  involved  flyinq  the  simulator  from  take-off  to  landinn  on 
the  specified  fliqht  plan.  The  second  was  respondinq  to  the  alerts  which  was 
done  by  performing  the  prescribed  actions  associated  with  each  alert. 

Before  participatinq  in  the  data  collection  fliqhts,  each  pilot  made  a  series 
of  practice  fliqhts.  The  purpose  of  these  flioht.s  was  twofold  -  to  acquaint 
the  pilots  with  the  fliqht  characterl sties  and  dynamics  of  the  simulation 
airplane  model  and  the  fliqht  plan;  and  to  become  proficient,  at.  oerforminn  the 
correct  alert  responses.  The  first  practice  fliqht,  was  R1  minutes  in  which 
the  complete  fliqht  pattern  was  flown.  There  were  no  alerts  to  distract  the 
pilots  durinq  most  of  this  flight.  The  instructions  on  how  to  respond  t.o  the 
alerts  were  explained  durinq  the  practice  fliqht,  and  any  questions  the  pilot 
had  were  answered.  The  second  practice  fliqht  included  a  short  seqment  after 
take-off  in  which  TCAS  alerts  were  presented  in  order  to  familiarize  the 
pilots  with  the  correct  TCAS  responses.  Then  the  aler+s  were  repeated  and  the 
pilots  were  asked  to  respond  to  them  by  performinq  the  corrective  action.  The 
time  for  training  was  two  and  one  half  hours. 


Table  4.5-1.  Random  Treatment  Assignments 
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Table  4.5-2.  Daily  Tatt  Schedule 


Day  1 

000-1:00 

Cab  warmup  and  preflight 

0:30-2:30 

Pilot  training 

2:30-4:30 

Flights  1  through  3 

4:30-5:15 

Lunch 

5:15-6:30 

Flights  4  and  5 

6:30-6:45 

Break 

6:45  -  8:00 

Flights  6  and  7 

Day  2 

000-1:00 

Cab  warmup  and  preflight 

1:00-3:00 

Flights  8  through  10 

3:00-3:15 

Break 

3:15-5:15 

Flights  1 1  through  13 

5:15-6:00 

Lunch 

6:00-7:15 

Flights  14  and  15 

7:15-8:00 

Pilot  debriefing 

The  test  day  consisted  of  eiqht.  fliqhts  with  approximately  four  hours  of 
flyina.  Rripf  rest,  periods  were  taken  throuqhout  the  day  in  an  effort  to 
reduce  fat.ique.  After  each  test,  fliqht  in  which  a  new  display  was  introducer 
the  pilots  were  qiven  a  short  questionnaire  (see  Aooendix  Cl  to  evaluate  the 
display.  Upon  completinq  the  data  collection  fliqhts  the  pilots  participated 
in  a  short  dehriefinq  session.  Their  impressions  of  the  TCAS  concepts  and  the 
application  of  these  concepts  were  solicited.  The  formal  dehriefinqs  included 
an  informal  discussion  between  the  pilots  and  experimenter  and  relevant  pilot 
corments  were  recorded  for  further  evaluation.  The  pilots  were  then  qiven  an 
extensive  questionnaire  which  they  were  to  complete  and  return  at  a  later 
date.  (See  Appendix  D ) . 

4.6  Measurement.  Technique 

4.6.1  Performance  Measures 

The  performance  measures  used  in  the  tests  fell  into  two  cat.eoories  -  those 
associated  with  the  fliqht  task  and  those  associated  with  thp  alert  response 
tasks.  The  parameters  that  reflect  how  well  the  Di^ot  performed  the  fliqht 
task  included  altitude  deviations,  wheel  and  column  reversals,  landinq 
performance,  accuracy  of  detection  of  the  outside  visual  tarapts.  The 
oarameters  were  especially  important  for  the  time  period  immediately  around 
the  alerts  because  they  provide  a  measure  of  the  efficiency  and  effectiveness 
of  the  pilot  in  performinq  the  fliqht  maneuver.  A  second  set  of  dependent 
variables, used  to  quantify  the  responses  to  the  alertinq  system,  included  the 
time  and  accuracy  of  alert,  detection,  and  the  time  and  accuracy  of  the 
response  to  the  alert. 

4.6.?  Subjective  Measures 

Finally,  subjective  data  expressinq  the  pilot's  opinions  about  the  various 
alertinq  system  charact.eri sties  were  aathered  for  all  test  confiourations. 

The  pilots  were  asked  to  comment,  on  and  rate  the  effectiveness  of  the 
candidate  TCAS  displays,  clarity  of  the  messaqe,  format  and  system  components. 
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Questionnaires  were  administered  immediately  after  each  fliqht.  In  which  a  new 
display  was  introduced  so  that  the  pilots  could  establish  their  reaction  to 
the  display  wh^e  it  was  still  fresh  in  their  minds.  These  questionnaires 
were  very  brief  and  directed  specifically  toward  a  display  used  in  the 
preceding  fliqht. 

After  completion  the  entry  test  sequence  the  pilots  participated  in  a 
debriefinq  which  permitted  them  t.o  provide  inputs  after  exneriencinn  all 
configurations.  This  debriefinq  consisted  of  an  informal  interview  after  the 
last  fliqht  and  an  extensive  questionnaire  (See  Anpendix  0)  which  the  pilots 
were  asked  to  take  with  them,  complete  and  return  at.  a  later  date.  The 
debriefinq  questionnaire  was  in  two  sections:  the  first  directed  toward 
bioqraphical  and  experimental  data;  and  the  second  section  was  directed  toward 
the  pilot's  opinion  about  collision  avoidance  systems  in  qeneral  and  the  test 
display  configurations  specifically. 

A  number  of  different  types  of  questions  were  asked  in  the  second  section  to 
provide  the  pilots  with  the  maximum  flexibility  for  expressing  their  opinion. 
The  first  type  of  question  used  was  the  ratinq  scale  in  which  a  question  was 
asked  and  the  pilot  was  qiven  a  scale  with  which  to  answer.  An  example  of  the 
type  of  questions  would  be: 

How  useful  is  includinq  the  vertical  speed  on  the  resolution  advisory 
display? 


Extremely 

Useful 

Of  No 

Detrimental  Extremely 

Useful 

Use 

Detrimental 

The  second  type  of  question  was  the  forced  choice  question  in  which  the  Dilot. 
was  asked  to  select  the  best  of  a  number  of  alternatives.  For  example: 


Tn  what  intervals  should  the  altitude  information  be  qiven? 


a.  One  foot.  _ 

b.  Ten  foot 

c .  Hundred  foot  _____ 

d.  Thousand  foot 

The  third  type  of  question  was  rank  orderinq  in  which  the  pilots  were  qiven  a 
list  of  alternatives  and  asked  to  rank  them  from  best,  to  worst.  The  fourth 
type  of  question  was  the  open-ended  pilot  opinion  in  which  the  pilot  is  asked 
the  questions  and  then  qiven  space  to  provide  his  answer.  For  example: 

What  information  should  a  collision  avoidance  system  provide? 

This  type  of  question  provides  for  a  written  structured  interview. 

The  next  technique  is  called  semantic  differentiation  which  was  used  to 
develop  opinion  profiles.  The  semantic  differential  provides  a  means  to  judqe 
opinion  in  a  systematic  way.  The  scale  was  developed  by  usinq  a  series  of 
polar  adjectives  and  requirinq  the  pilots  to  indicate  where  their  opinion 
falls  between  the  ends  of  the  scale.  An  example  of  this  type  of  question 
would  be: 


Suppose  the  pilot  is  asked  to  iudqe  one  of  the  TCAS  display  options  on  the 
followinq  scale: 


Good 


Bad 


If  he  feels  that  the  display  is  very  qood  he  would  check  the  box  nearest  that 
adjective.  An  opposite  reaction  would  result  in  a  check  at  the  other  end  of 
the  scale  and  a  neutral  opinion  would  result  in  the  center  box  beinq  marked. 
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Finally  the  pilots  were  asked  to  design  their  ideal  system  including  necessary 
components,  information  requirements  and  the  format  of  the  displays.  They 
were  asked  to  relate  the  system  to  both  a  conventional  and  advanced  fliaht 
deck  design. 

4.7  Data  Reduction  and  Analyses 

The  data  obtained  in  the  Developmental  Simulation  testinq  falls  into 
two  qeneral  categories  -  objective  (or  performance)  data  and  subjective 
(questionnai re/debrief inq)  data,  k  time-based  tabulation  of  all  events  that 
occurred  in  the  cab,  switch  and  light  states,  displayed  messaaes  and  fault 
situation  initiation,  was  generated  from  the  data.  From  this  tabulation, 
sums,  means  and  standard  deviations  were  calculated  for  all  performance 
variables.  The  performance  was  analyzed  with  respect  to  all  the  alerts  and 
was  also  partitioned  from  the  various  alert  categories.  Analyses  of  variance 
were  performed  on  the  reduced  data  to  determine  if  tbe  various  treatment 
conditions  had  a  differential  affect  upon  performance.  The  statistical  model 
used  for  the  data  reduction  was  the  analyses  of  variance.  As  described  in 
Section  4.2,  two  separate  analyses  were  performed  both  of  which  were  mixed 
designs.  All  of  the  pilots  had  treatment  conditions  associated  with  a  portion 
of  the  variables  but  one  variable  (percent  no-RA  encounters)  divided  the 
pilots  into  two  qroups.  The  model  and  source  table  for  this  type  of  analyses 
is  presented  in  Table  4.7-1. 

Since  developmental  testinq  requires  that  system  developers  be  very  sure 
before  they  reject  any  candidate  system  concept,  and  since  the  time  critical 
tests  were  exploratory  in  nature,  an  error  probability  of  .10  was  selected  as 
a  test  for  significance  for  t.he  statistical  tests  performed  on  both 
experiments. 

4.7.1  Experimental  Hypothesis 

The  foil  owl nq  were  the  hypotheses  upon  which  the  tests  were  based; 

1.  Pilot  detection  time  is  not  affected  by  the  type  of  alert  (i.e.  warning 
versus  advisory). 
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Table  4.7-1.  Sample  of  Analysis  of  Variance  Model  and  Summary  Table  for  a  Factorial 
Experiment  With  Repeated  Measures  on  Some  of  the  Factors 


Model 

*ikj  ~  F+  0-y  +  T^jj)  +  +  ofijj  +  0Tjk(j)  +  ek(ij) 

Summary  table 

Source 

Expected  mean  square 

F  ratio 

A 

090 
+  ba  os  +  nb  o ^ 

MVMsSUb 

Subj^-t  within  A 

°e2  +  °s2 

B 

9  9  2 

°e  +  a  aB$  +  na  aB 

msb/msBs 

A  x  B 

°e2  +  3  a8s2  +  "  °AB2 

MSAB/MSBs 

B  x  subjects  within  A 

ae2  +  aoBs2 

Note:  The  example  is  a  two-factor  experiment  with  repeated  measures  on  one  factor. 


?..  The  presence  or  absence  of  the  traffic  alert  will  not  have  an  effect  on 
the  detection  of  the  resolution  advisory. 

3.  The  tyoe  of  traffic  advisory  presented  will  not  affect,  the  Initial 
detection  time  of  the  alert. 

4.  The  percent  of  none-RA  encounters  will  have  no  effect  on  detection  time. 

5.  ATC  traffic  advisories  will  be  detected  .lust,  as  fast  as  any  Internal 
alert. 

fi.  The  location  of  the  traffic  advisory  visual  alert  has  no  effect  on 
detection  performance. 

7 .  The  type  of  traffic  advisory  has  no  effect  on  the  pilots  response 
performance. 

R.  The  presence  or  absence  of  a  traffic  alert  has  no  effect  on  response 
performance. 

o.  Voice  presentation  of  the  resolution  advisory  is  lust,  as  effective  as 
voice  comhined  with  visual  in  produclnq  the  correct  response. 

10.  The  IVSI  and  LEO  resolution  advisory  displays  arp  equally  as  effectivp 
as  measured  by  response  performance. 

11.  The  percent  non-RA  encounters  will  have  no  effect  on  response 
performance. 

12.  Altitude  chanqe  durlnq  the  response  will  not  be  related  to  any  of  the 
test  variables. 

13.  The  accuracy  of  the  pilots'  response  will  not  be  related  to  any  of  the 
test  variables. 
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4.8  Test  Results 


A1 thouqh  some  of  the  results  reported  in  the  following  sections  as  beina 
statistically  significant  may  appear  to  he  of  insufficient  magnitude  to  be  of 
practical  importance,  this  may  be  a  false  assessment  of  the  results  due  to  the 
nature  of  the  tests.  It  must  be  kept  in  mind  that,  the  pilots  knew  alerts 
were  qoinq  to  occur  during  the  flight,  and  the  anticipation  ot  the  alert 
resulted  in  a  response  that  was  faster  than  would  normally  occur.  The  speed 
that,  a  Dilot  can  respond  to  an  alert  is  a  function  of  certain  physical  factors 
such  as  recognition  and  reaction  times.  As  a  Dilot  responds  faster  he 
approaches  these  physical  limits.  As  these  limits  are  approached  it  is  found 
that  the  response  times  tend  to  group  or  stack  up  at.  the  low  end  of  the  scale. 
This  factor  has  the  effect  of  reducing  t.he  spread  of  response  time  scores. 
Another  example  of  this  type  of  effect  can  be  seen  in  a  simple  physical  experi¬ 
ment  of  throwing  a  hall.  Imagine  inn  neople  throwing  a  ball  as  far  as  they 
can.  Each  person's  score  would  be  the  distance  their  ball  traveled.  For  the 
first  throw  there  is  a  spread  of  scores  from  say  Sn  to  188  ft.  and  the  distri¬ 
bution  of  scores  was  bell  shaped  with  the  most  scores  occurring  at.  l?n  ft. 

Now  for  the  second  throw  a  larqe  wall  is  built  at  ion  ft.  All  those  Deople 
who  can't  throw  further  than  100  ft.  will  throw  lust  like  they  did  at  first. 
However,  the  rest  of  the  people  will  hit  the  wall  and  it  will  look  in  their 
scores  like  they  can  only  throw  100  ft.  This  will  reduce  the  spread  of  the 
scores  thus  reducing  the  variability  of  the  results.  In  the  actual  TEAS 
operation,  it  is  expected  that  t.he  pilots  will  not  be  anticipating  the  alerts 
and  therefore  the  overall  response  times  will  be  slower  getting  them  away  from 
the  "wall"  of  the  physical  parameters  and  permitting  a  wider  rangp  of  times. 
This  would  have  the  effect  of  increasing  the  observed  size  of  any  real 
differences  that  exist  between  the  experimental  treatments  (14,  18,  161. 

4.8.1  Detection  Times 

Detection  time  has  been  defined  as  the  time  from  the  initiation  of  the  alert 
to  when  the  pilot  first  noticed  that  either  an  alert  had  occurred  or  any 
existinq  alert  had  chanqed  urgency  level.  These  two  detection  times  actually 
have  different  meaninqs  in  the  alerting  paradigm.  The  initial  detection  is  a 
measure  of  the  attention  qetting  quality  of  the  alert.  Alert  chanqe 
detection,  on  the  other  hand,  reveals  how  well  the  alert  is  transmitting 
urgency  information  and  could  possibly  provide  a  measure  of  complexity. 
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The  analysis  of  variance  sugary  tables  for  the  initial  detection  time  is 
presented  in  Table  4. 8. 1-1.  The  main  effect  attributed  to  the  alert  display 
was  siqnficant  ( F=1 S . oq  Hf  6,60)  and  can  be  seen  in  Fiqure  4. ft. 1-1.  Usinn 
Duncan's  New  Multiple  Ranqe  test  it  was  discovered  that  the  CRT  display  and 
sound  (4.84  seconds  to  5.25  seconds)  were  detected  siqnificantly  slower  than 
either  the  TCAS  lioht  and  advisory  sound  (4.20  seconds)  or  the  resolution 
advisory  with  no  caution  alerts  (2. 50  seconds).  Lookino  at  the  detections  for 
each  level  of  urqency  the  proximate  advisory  (PA)  is  detected  siqnficant.ly 
'  slower  (as  expected!  than  either  the  traffic  alert  (TA)  or  the  resolution 

advisory  (RA)  for  all  the  display  types  (F=55.ft  df  2,12).  As  can  be  in  Fiqure 
4. 8. 1-2  usino  the  TCAS  liqht  as  the  caution  alert  resulted  in  the  shortest 
detection  time  (1.45  sec)  for  the  RA.  This  time  was  siqnficant.ly  shorter  than 
either  the  2.52  seconds  for  the  RA  without  cautions  (t=R.l  df  22)  or  the  2.15 
seconds  when  usinq  the  CRT  as  a  for  caution  alerts  ft=l.Q  df  22).  The  detec¬ 
tion  of  the  ATC  traffic  advisory  is  comparable  to  usinq  the  advisory  sound  and 
CRT.  Finally,  the  percent  of  encounters  that,  proqressed  to  an  RA  had  no 
effect  either  on  the  detection  ot  the  initial  alert  or  on  the  detection  of  the 
RA.  Nor  were  there  any  interactive  effects  between  the  alert  type  and  the 
percent  of  non-RA  encounters. 

4.8.2  Response  Times 

The  analysis  of  various  summary  tables  for  the  response  times  is  presented  in 
Table  4. ft. 2-1.  The  mean  effect  attributed  to  the  traffic  display  was 
siqnificant  (F=2.34  df  3, 30)  with  the  mean  response  time  for  the  RA  which  was 
preceded  by  the  TCAS  liqht  (3.49  seconds)  beinq  siqnificantly  shorter  than  for 
those  conditions  with  either  no  precursors  (4.57  seconds)  or  when  the  CRT  was 
used  as  a  precursor  (4.6  seconds  to  4.3R  seconds).  This  result  may  he  mis- 
leadinq,  however,  due  to  the  composition  of  the  response  time.  Each  resoonse 
had  two  components,  the  time  to  detect,  the  alert  and  the  time  to  respond.  As 
can  be  seen  in  Fiqure  4. 8. 2-1  the  siqnificant  differences  found  in  the 
response  time  is  due  solely  to  the  differences  in  the  RA  detection  times. 

When  the  component  is  factored  out,  there  are  no  measurable  differences  in  the 
response  times  amonq  the  treatment  conditions. 
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Table  4. 8.1-1.  ANOVA  Summary  Table  for  Initial  Detection  Time 


Source 

Sum  of 
squares 

Degrees  of 
freedom 

Mean 

square 

u. 

Probability  F 
exceeded 

Mean 

1.930.05 

1 

1,930.05 

457.05 

Non-RA  (N) 

5.11 

1 

5.11 

1.21 

Error 

42.22 

10 

4.22 

Alert  display  (A) 

80.84 

6 

13.47 

AN 

2.30 

6 

0.38 

15.98 

0.0 

Error 

50.55 

60 

0.84 

0.45 

0.8 
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'All  visual  displays  were  accompanied  by  a  master  aural  alert. 


Figure  4.8. 1-1.  Initial  Detection  Time  as  a  Function  of  Alert  Display 
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Figure  4.8. 1-2.  Alert  Detection  Time-TA  Display 
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Table  4.8.2- 1.  ANOVA  Summary  Table  for  Response  Times 


Source 

Sum  of 
squares 

Degrees  of 
freedom 

Mean 

square 

F 

Probability  F 

exceeded 

Mean 

5,406.86 

1 

5,406.86 

816.34 

0.00 

Non-RA  encounters  (N) 

4.39 

1 

4.39 

0.66 

0.43 

Error 

66.23 

10 

6.62 

R A  display  type  <R) 

182.85 

2 

91.42 

51.71 

0.00 

RxN 

1.10 

2 

0.55 

0.31 

0.73 

Error 

35.35 

20 

1.76 

TA  display  type  (T) 

8.91 

3 

2.97 

2.34 

0.10 

TxN 

1.66 

3 

0.55 

0.43 

0.72 

Error 

38.21 

30 

1.27 

RxT 

3.10 

6 

0.51 

0.32 

0.92 

RxTxN 

8.24 

6 

1.37 

0.86 

0.52 

Error 

95.36 

1.58 

Vertical  maneuver  (V) 

1.12 

1 

1.12 

1.57 

0.23 

VxN 

1.10 

1 

1.10 

1.56 

0.23 

Error 

7.11 

10 

0.71 

RxV 

0.49 

2 

0.24 

0.21 

RxVxN 

0.81 

2 

0.40 

0.35 

0.70 

Error 

22.75 

20 

1.13 

TxV 

1.25 

3 

0.41 

0.38 

0.76 

TxVxN 

1.39 

3 

0.46 

0.43 

0.73 

Error 

32.18 

30 

1.07 

RxTxV 

5.77 

6 

0.96 

0.95 

0.46 

RxTxVxN 

8.69 

6 

1.44 

1.43 

0.21 

Error 

60.60 

60 

1.01 
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Figure  4.8.2-1.  A  Comparison  of  Response  and  Detection  Times  as  a  Function  of  the  Traffic  Display 

The  main  effect  attributed  to  the  resolution  advisory  display  was  also 
significant  (F=51.71  df  2,20).  The  mean  response  time  for  t.he  voice  only 
condition  (5.45  seconds!  was  sianificantly  lonqer  than  for  either  the  IVSI 
(3.63  seconds)  or  the  LED  (3.94  seconds)  display.  When  combined  with  voice 
even  thouqh  the  IVSI  display  consistently  produced  shorter  response  times  than 
the  LEO  display,  the  mean  differences  were  not  statistically  significant. 

When  the  response  times  are  aqain  partitioned  into  these  two  components  it  can 
be  seen  (Fiqure  4, ft.?-?)  that,  the  differences  observed  between  displays  are 
due  in  this  case  to  the  response  to  the  display  rather  than  the  detection  of 
the  RA  condition.  The  detection  time  curve  has  no  measurable  difference 
across  the  displays  while  the  response  curve  does  exhibit  the  pronounced 
difference  for  the  voice  display.  . 

4. ft. 3  Missed  Alerts  and  Incorrect  Responses 

The  pilots  responded  to  all  of  the  alerts.  In  all  cases  the  direction  of 
response  was  correct.  This  result  corresponds  to  the  data  obtained  from 
previous  alerting  studies  in  which  no  warninq  level  alerts  were  missed.  There 
were  some  alerts,  however,  which  though  correct  in  direction  were  not  of  the 
orescribed  magnitude  (ft  feet  per  second  squared)  and  therefore  were  not 
included  in  the  data.  This  set  of  responses  (105)  constituted  eiqht  percent 
of  the  total  number  of  responses  (1380)  and  was  not  concentrated  in  any  one 
treatment  condition. 

4.8.4  Pilot  Input 

The  debriefinq  questionnaire  is  presented  in  Appendix  D.  Ninety-two  percent 
of  the  pilots  who  participated  in  the  simulator  tests  returned  a  completed 
questionnaire.  The  majority  (75%)  of  pilots  participation  in  the  test  were 
familiar  with  the  TCAS  proqram  prior  to  testinq.  This  fact  does  not  make  the 
opinions  expressed  any  less  usable;  however,  it  does  suggest  that  the  test 
deslqn  and  display  configurations  mav  have  had  less  impact,  on  the  opinions  of 
this  qroup  of  pilots  than  they  would  have  had  on  a  less  informed  qroup. 

The  most  often  stated  aspect  reauired  of  the  TCAS  system  was  reliability. 
Seventy-five  percent  of  the  pilots  felt  that  the  system  should  not  be  required 
on  aircraft  until  it  can  be  demonstrated  to  perform  reliably.  The  three 
criteria  that  were  mentioned  for  system  implementation  were: 
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System  Reliability 


o  Economic  ,'<easonabil  it.y 

o  ATC  Comoatibil i ty 


System  unreliability  was  most  oft.pn  Given  as  the  only  reason  for  the  pilot  not 
following  the  RA  guidance.  Seventy-five  percent  of  the  pilots  felt  that  the 
system  should  be  designed  so  that  the  pilot  would  not.  be  justified  in  refusing 
to  do  the  RA  maneuver.  In  reviewing  the  test  system,  all  of  the  pilots  said 
they  usually  agreed  with  the  guidance  presented.  Some  concern  was  voiced, 
however,  that  when  they  did  not  aoree  with  the  alert  (for  whatever  reason!, 
there  was  some  hesitation  in  following  it. 

When  considering  the  operational  environment  eighty-four  percent  of  the  pilots 
responded  that  horizontal  maneuvers  should  be  considered  in  the  TCAS  system 
for  those  situations  where  a  vertical  maneuver  may  be  inappropriate  such  as: 
when  operating  close  to  the  ground  or  obstacles;  when  close  to  performance 
limits  of  the  aircraft;  when  given  a  hard  altitude  by  ATC;  to  eliminate 
crossing  altitudes;  in  high  density  situations.  Aorpement  was  not  reached  on 
changes  in  the  amount  of  communication  that  will  he  required  with  ATC, 
forty-two  percent  saw  a  decrease  and  sixteen  percent  said  that,  it  would  remain 
unchanged.  There  were  some  chanqes  in  operational  procedures  that,  were 
identified  as  beinq  required  for  TCAS  implementation.  These  were:  providing 
the  Captain  with  emergency  authority  to  break  clearance  due  to  an  RA;  provide, 
for  an  automatic  transmission  to  ATC  when  an  RA  occurs;  definina  who  has 
authority  if  ATC  and  RA  should  provide  conflicting  commands.  Finally  the 
pilots  report  that  even  thouqh  there  should  be  no  reduction  in  present  traffic 
separation,  (75?-),  they  would  feel  more  confident  when  overflyinq  another 
aircraft  and  that  TCAS  would  result  in  a  safer  operational  environment  (inn?). 

In  conjunction  with  opinions  concerning  general  system  operations,  it  was  also 
an  objective  to  obtain  more  specific  reactions  to  the  system  features.  The 
following  will  be  a  summary  of  those  questions  dealinq  with  the  three  major 
system  components,  the  master  alerts,  the  resolution  advisory  and  the  traffic 
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information  display.  Eiqhty-four  percent,  of  the  pilots  responded  that  both  an 
aural  and  visual  master  alert  were  needed  to  qet  the  crew's  attention  under 
all  conditions.  Ninety-two  percent  of  the  pilots  rated  the  aural  sounds  used 
in  the  test  as  either  good  or  excellent.  It  was  indicated,  however,  that 
three  levels  of  aiert.inq  urgency  were  too  many  and  only  two  levels  were 
recommended,  caution  (TA)  and  warninq  (RA).  The  attention  qettinq  quality  of 
the  master  alerts  was  also  rated  as  qood  to  excellent,  by  ninety-two  percent  of 
the  pilots.  Changes  that  were  recommended  concerninq  the  master  alert  were 
primarily  directed  toward  the  timinq  sequences.  Some  of  the  pilots  were 
bothered  by  the?  fact  that  the  tone  and  the  lioht  and  the  CRT  displays  did  not 
all  come  on  at  the  same  time.  This  lack  of  coordination  was  caused  by  the  way 
that  the  alerts  were  initiated  because  the  aural  alerts  had  a  direct  path  te 
the  main  computer  and  the  visual  alerts  were  dependent  on  the  RfiJ  update  rate 
(?.  seconds).  This  problem  will  be  solved  for  future  testing. 

AH  of  the  pilots  felt  that,  some  form  of  caution  level  alert  would  benefit  the 
TCAS  system.  The  reasons  most  often  given  for  havinq  the  caution  alert  (R4%) 
were  to  reduce  the  startle  effect,  of  the  RA  and  to  prepare  the  crew  for 
possible  action.  The  answer  to  the  question  of  how  t.o  provide  this 
preliminary  alert,  was  not  so  clear  cut.  Forty-five  Doreen*-  of  the  pilots 
reported  that  an  amber  light  should  be  used  and  fifty-five  percent  wanted  to 
see  a  qraphlc  CRT  presentation.  In  conjunction  with  this  result,  sixty-severe 
percent  of  the  pilots  expressed  concern  that  an  automated  traffic  advisory 
display  (CRT)  could  lead  to  pilot  complacency  with  insufficient  visual  scan 
time  beinq  devoted  t.o  nont.ransponder-equioned  aircraft- 

The  data  indicates  that  if  a  traffic  information  display  is  included  it  should 
present  the  information  graphically  (100%)  using  color  for  the  urgency  levpl 
(100%).  The  average  number  of  traffic  advisories  that  the  pilots  felt,  they 
could  monitor  simultaneously  while  attending  t.o  flight,  duties  were  2. A 
intruders  and  the  ranqe  of  responses  was  from  zero  to  five  intruders.  As  can 
be  seen  in  Fiqure  4.R.4-1  t.be  graphic  displays  were  considered  morp  useful 
than  current.  ATC  traffic  advisories.  If  hparirto  information  is  included  on 
the  tabular  display,  the  pilots  considered  the  display  equally  as  useful  as 
the  ATC  traffic  advisories;  however,  *he  maiorit.y  of  the  pilots  (7F)% 
commented  that  this  was  true  only  for  a  single  intruder.  If  multipip 
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Figure  4. 8. 4-1.  Pilot  Opinion  Concerning  the  TA  Display  Usefulness 
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intruders  were  present,  the  tabular  display  was  much  more  difficult  to  use 
even  with  bearina  information  presented  on  the  displays.  The  graphic  displays 
were  rated  the  least  ambiouous  and  the  tabular  display  without  hearinq 
information,  the  most.  The  advanced  qraphic  display  was  the  most  preferred 
CRT  traffic  advisory  format,  beinq  preferred  by  ninety-two  oercent  of  the 
pilots. 

There  was  no  consensus  amonq  the  pilots  as  to  what  traffic  should  be  presented 
if  a  CRT  type  of  display  is  available.  Thirty-three  percent  of  the  pilots 
felt  that  only  threats  as  defined  by  TCAS  should  be  presented  and  thirty-three 
percent  felt  that  TCAS  threats  should  be  presented  with  the  option  of  display¬ 
ing  surroundinq  traffic  when  a  threat,  is  present,  finally  thirty-three  percent 
felt  that  the  surroundinq  traffic  should  apoear  automatically  when  a  TCAS 
threat  is  present.  When  an  intruder  is  shown  on  the  CRT,  the  majority  of 
pilots  required  the  following  information  about  it:  bearinq  data  (67T); 
horizontal  separation  (75*1  both  range  and  time;  and  the  altitude  of  the 
intruder  if  known  (100*1  relative  to  own  altitude  (75*)  and  in  hundred  foot 
increments  (02*1.  Other  information  that  some  of  the  pilots  would  like  to 
know  about  the  intruder  includes:  direction  of  vertical  movement  (.13*; 
closure  rates  (33*1;  heading  or  track  (2^*1;  and  vertical  speed  (17*).  One 
option  available  on  the  traffic  display  is  to  permit  the  intruder  aircraft  to 
remain  on  the  display  after  a  corrective  maneuver  has  been  accomplished,  t.o 
show  the  pilot  where  it  went.  The  maiority  of  the  pilots  tested  (57*)  felt, 
that  this  feature  would  not  be  useful.  When  investiqatinq  the  traffic 
information  display  utility  with  respect  to  fliqht.  phases  the  pilots  felt  that 
it  would  be  most  useful  in  the  climb,  cruise,  descent  and  approach  phases  and 
least  useful  durinq  takeoff  and  landina. 

Th»  third  component  of  the  TCAS  display  system  is  the  resolution  advisory 
display.  Ninety-two  percent  of  the  pilots  tested  felt,  that  corrective  types 
of  RA's  (e.q,  CLIMB  or  LIMIT  DESCENT  to  500  fpm)  are  necessary  to  the  system 
and  only  thirty-three  percent  felt  that  predictive  alerts  (e.q.,  don't 
descent)  are  necessary.  Sixty-seven  percent  of  the  pilots  rated  the 
corrective  alerts  more  critical  than  the  predictive  while  none  of  the  piTots 
selected  the  opposite  rat.inq.  For  the  presentation  of  the  corrective  alerts, 
an  arrow  was  selected  as  the  most  appropriate  indication  of  a  vertical 
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maneuver  (100?,).  Since  the  present,  system  only  provides  for  vertical 
resolution  advisories,  ninety-two  percent,  of  the  pilots  indicated  that  the 
vertical  speed  should  he  included  on  the  resolution  advisory  display. 
Considering  these  responses  it  is  not  unexpected  that  the  modified  1  VST  was 
rated  the  clearest,  least  ambiquous  resolution  advisory  display  (see  Figure 
4. a. 4-2)  and  the  LED  display  the  least  clear,  especially  hy  those  pilots  who 
saw  both  vertical  maneuver  alerts  and  vertical  limit  alerts. 

Care  must  he  used  in  selecting  the  voice  messaqes.  Durinq  the  test  a  numher 
of  occasions  were  reported  where  the  pilot  mistook  the  voic*  alert  "Limit 
climb  two  thousand  feet  per  minute"  as  heinq  "Limit  climb  to  a  thousand  feet 
per  minute".  Ninety-two  percent,  of  the  pilots  felt.  that,  the  modification  of 
the  TVS  I  did  not  fletract  from  the  primary  purpose  of  the  instrument  and  that, 
the  use  of  color  did  help  the  interpretation  of  the  information  presented. 

Some  of  the  chanqes  suqqested  for  the  displays  used  in  the  test  include: 

IVSI  -  make  brightness  adjustable 

add  horizontal  maneuver  arrows 

indicate  required  climb  rate 
make  needle  more  visible 
LED  -  reduce  complexity 

make  brightness  adiustable 

move  to  qlareshield 

VOICE  -  reword  messaqes  to  eliminate  amhloulty 

automatically  cancel  after  two  repetitions 
make  more  urgent. 

Finally,  all  of  the  pilots  felt,  that  the  alerts  provided  them  sufficient  time 
to  react  and  the  pilots  usually  aqreed  with  the  resolution  advisory. 
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NEVER 


SELDOM 


USUALLY 


ALWAYS 


*  Mean  from  pilots  who  received  limit  commands 


95%  confidence  limit 


•  Was  the  RA  display  clear  and  unambiguous? 
* 


_ I _ I _ _ 

IVSI  LED  V 

RA  DISPLAY 

Figure  4. 8.4-2.  Pilot  Opinion  Concerning  the  RA  Display  Clarity 


5.0  DISCUSSION  ANO  CONCLUSIONS 


Since  any  collision  avoidance  warning  can  be  defined  as  a  time-critical  alert, 
of  primary  importance  when  conslderinq  the  display  system  to  he  used  is  the 
speed  and  accuracy  of  the  response  produced.  Therefore,  anythinq  that 
Increases  the  speed  of  alert  detection  and  response  without  havina  an  adverse 
effect  on  response  accuracy  should  be  considered  in  the  system 
recommendations. 

Care  must  be  used  when  interpreting  the  results  of  this  experiment  and  their 
real  world  sionificance,  because  the  pilots  know  that  alerts  are  qoinq  t.o 
occur  durinq  any  experimentation  with  crew  alert.ino.  When  investiqatinq 
time-critical  alerts  especially,  the  time  between  alerts  must  be  artificially 
short  because  the  experiments  would  not  be  very  cost  effective  if  a  more 
realistic  time  scale  were  used.  Therefore,  in  the  nresent  study,  the  pilots 
were  exoectinq  the  alerts  and  their  responses  were  faster  than  they  would 
normally  be.  They  were  also  fast.er  because  the  pilots  did  not  have  to 
complete  the  entire  evasive  maneuver  for  their  response  hu*  rather  they  only 
had  to  attain  an  acceleration  of  .?5C.  These  constraints  lead  t.o  a  skewina  of 
the  data  toward  zero  and  reduced  the  differences  amonq  treatment  means  raisino 
the  level  of  difficulty  in  discoverinq  si onif leant  differences  between  the 
means.  Therefore,  any  effects  that  were  found  to  be  statistically  siqnificant 
should  be  considered  even  thouqh  they  may  not  look  to  he  of  practical  siqnifi- 
cance,  since  it  is  expected  that  the  differences  will  become  laroer  in  real 
life  situations. 

The  results  of  the  study  indicate  that  not  only  the  initial  detection  time  but 
also  the  chanqe  detection  time  is  very  sensitive  to  the  alertinq  displays. 

The  initial  detection  time  was  dependent  on  three  basic  alert  combinations:  a 

red  liqht  in  the  primary  fie’d  of  view  with  a  warm' no  sound;  an  amber  lioht  in 

the  primary  field  of  view  with  a  chime;  and  a  CRT  display  in  the  secondary 

field  of  view  with  the  chime.  Each  of  these  combinations  produced  a 
siqnificant.ly  different  mean  detection  time  from  the  others.  T*«>  warning 
liqht  and  sound  producing  a  faster  detection  than  t>a  amber  liqht  and  sound 
even  thouqh  the  amber  liqht  had  twice  the  lighted  surface  area  than  the  red 
liqht.  The  warning  alert  also  had  a  voice  component  which  could  have  been 
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cont.ribut.inq  t.o  detection  performance;  however,  if  this  were  the  case,  the 
ATC  traffic  advisories  should  have  been  detected  faster  than  the  TCA^  "•  i aht . 
This  was  not.  the  case.  These  results  tend  to  indicate  that  the  sound 
characteristics  were  more  important  in  attraction  the  crew's  attention.  It. 
shows  that  tor  warninq  situations,  especially  when  time  is  critical,  a  chime 
may  not  be  able  to  produce  sufficiently  rapid  response  times.  The  results, 
that  show  sioni ficantl v  faster  detection  with  a  liqht  in  the  orimary  field  of 
view  than  with  a  visual  display  in  the  secondary  field  of  view,  are  consistent 
with  previous  studies  ( 7 , P )  and  indicate  that  if  the  alert  requires  immmediate 
attention,  a  visual  alert  should  be  located  in  the  primary  field  of  view  and 
combined  with  a  sound  that,  is  appropriate  for  the  urqency  level. 

The  next,  question  to  answer  is  whether  or  not  the  caution  or  "qet.  ready"  alert 
is  benefical  and  how  much  information  does  it  need  to  supply  to  the  crew.  If 
the  system  is  qoinq  to  use  multiple  urqency  levels,  the  detection  of  level 
chanqe  becomes  an  important,  factor.  The  TCAS  liqht  represents  the  least, 
complex  caution  alert.  The  only  information  that  it.  carries  is  the  fact  that 
an  intruder  aircraft  has  come  to  a  caution  level  position.  This  alert 
resulted  in  a  siqnificant  improvement  in  the  RA  detection  time  when  compared 
to  RA's  which  had  no  previous  caution.  One  miaht.  then  ask,  if  a  little  bit.  is 
qood,  should  more  be  better?  The  conditions  that  used  the  CRT  display  fo>" 
traffic  had  two  alert  levels  before  the  P.A.  With  the  urqency  levels  chanqino 
every  ten  seconds  you  would  expect  that,  havinq  two  urqency  levels  before  the 
RA  would  be  as  qood  or  better  than  the  sinqle  level  and  sionficantly  better 
than  with  none  at  all.  This  was  not  the  case.  As  the  results  show,  the  RA 
detection  with  the  CRT  traffic  displays  was  siqnficantly  slower  than  with  the 
TACS  cuation  liqht.  There  was  no  measurable  difference  between  havinq  a  CRT 
for  the  lower  level  alert  and  havinq  no  caution  at  all.  This  findinq  indicates 
that  somethinq  else  is  overcominq  the  advantaqe  created  by  usinq  the  CRT  as  a 
for  the  caution  level  alerts.  It  the  RA  is  considered  an  intrudina  task  when 
the  pilot  is  usinq  the  traffic  display,  a  workload  explanation  can  be  postu¬ 
lated  for  the  increase  in  detection  time.  Rol  fe  l\?)  has  shown  that,  as  work¬ 
load  increases  the  performance  of  other  tasks  decreases.  Therefore,  as  the 
traffic  display  presents  the  pilot  with  an  increase  in  information  it  hecomes 
more  difficult  for  the  resolution  advisory  to  attract  his  attention  and  there¬ 
fore  for  him  t.o  start  the  correct  response.  The  response  performance  also 
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indicated  this  effect.  Response  time  to  the  RA  which  followed  the  TCAS  liqht 
(TA  alert  with  the  least  information)  was  sianificantly  shorten  than  the  times 
for  the  RA  response  followinq  a  CRT  presented  TA.  It  was  further  found  that 
when  the  response  time  was  broken  into  its  two  components,  thp  detection 
component  and  the  response  component,  the  former  was  the  drivinn  facter  in  the 
overall  time.  This  indicates  that  when  the  time  to  respond  is  the  only 
measurement  criteria,  the  sooner  the  pilot  qets  the  critics1  information  the 
faster  he  will  respond.  In  the  case  of  this  study,  the  critical  information 
was  the  qui dance  presented  on  the  resolution  advisory  display. 

Another  benefit  attributed  to  the  information  on  the  CRT  display  is  that  it. 
will  permit  the  pilot  to  anticipate  the  direction  of  the  resolution  advisory 
maneuver  if  he  is  familiar  with  the  alqorithms.  In  order  t.o  look  at  this 
effect,  the  pilots  were  hriefed  that  the  resolution  advisory  would  always 
direct  them  vertically  away  from  the  intruder  (i.e.,  if  the  intruder  is  above 
the  RA  will  be  "Descend").  With  this  type  of  instruction,  the  pilots  should 
have  been  able  t.o  use  the  positional  information  on  the  CRT  to  prepare  for  the 
RA  maneuver  and  thus  perform  the  maneuver  faster  than  when  they  din  not  have 
the  information.  Even  t.houoh  sixty-seven  percent  of  the  pilots  reported  that 
they  were  usino  the  CRT  information  to  anticipate  the  RA  maneuver,  the  perfor¬ 
mance  data  do  not  support  this  result.  As  pointed  out  above,  the  differences 
observed  in  response  performance  were  due  almost  exclusively  to  the  differ¬ 
ences  in  t.h«>  time  to  detect  the  resolution  advisory.  Once  the  alert,  has  been 
detected,  the  response  is  not  dependent  on  the  amount  of  information  the  pilot 
had  prior  to  the  alert. 

The  resolution  advisory  display  did  have  an  effect  on  the  pilots  response 
performance,  and  when  the  response  times  were  partitioned  into  thp  detection 
and  response  components  it  was  found,  as  expected,  that  the  differences  were 
due  to  the  response  component.  Therefore,  the  presentation  media  and  format 
of  the  RA  information  was  affectinq  the  pilots  resoonse.  The  modified  IVSI 
when  combined  with  voice  resulted  in  th»  quickest  responses  and  the  voice 
alone  the  slowest.  The  results  support  the  pilots  contention  that  they  were 
usinq  the  visual  display  to  initiate  the  action  and  the  voice  t.o  verify 
response  accuracy.  To  accomplish  this  procedure  with  the  voice  display  alone 
would  require  extra  time  due  to  thp  serious  nature  of  the  voice  mpssaqe. 
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These  data  support,  previous  findinqs,  a  summary  of  which  can  ho  soon  in  Fiqure 
C'.D-1,  (IT)  which  indicate  that  the  host  presentation  method  for  information 
which  requires  rapid  action  is  hy  usino  a  combination  of  voice  and  visual 
displays.  The  complexity  of  the  information  presented  on  the  visual  display 
seems  to  have  been  a  contribution  factor  to  the  response  and  preference 
differences  between  the  I  VS  T  and  LED  displays.  The  pilots  felt  that  the  LED 
display  was  overly  complex  and  the  data  tend  to  support,  this  f»elinq.  Even 
thouqh  both  displays  presented  a  directional  arrow  for  t>e  alert,  the  response 
to  the  LED  was  consistently  slower  than  to  the  T VST .  The  increase  in  visual 
complexity  with  the  tri-color  backqround  could  have  caused  the  difference.  The 
lack  of  a  dynamic  vertical  speed  indication  on  the  LED  display  was  discussed 
as  a  ma.ior  drawback  for  the  vertical  limit  alerts  as  was  the  perceived 
amhiquity  of  the  display. 

The  pilot,  inputs  have  been  reported  in  the  results  section  and  in  previous 
studies  (4, 6,7,8).  They  support  a  system  that,  has  two  levels  of  urqency, 
caution  and  warninq,  with  master  alerts,  both  visual  and  aural,  announcinq 
pach  level.  The  resolution  advisory  display  should  provide  ouidance  informa¬ 
tion  in  as  straiqht.  forward  and  least  complex  manner  as  possible.  Arrows 
Should  be  used  to  show  the  direction  of  the  prescribed  maneuver  and  bars  or 
some  other  index  should  be  used  in  conjunction  with  a  vertical  speed  indicator 
to  set  vertical  limits.  Color  is  desirable  but  too  much  color  confuses  the 
display.  The  voice  messaqes  should  be  consistent  with  the  visual  display  and 
they  should  be  distinctive  so  that  there  is  no  confusion  between  a’erts. 

The  pilots  were  unanimous  in  their  desire  for  a  caution  levpl  alert,  but  their 
opinion  was  mixed  as  to  how  this  should  be  implemented.  If  however,  some  form 
of  traffic  display  were  included  in  the  system,  thpre  are  certain  characteris¬ 
tics  that  the  pilots  would  like  the  display  to  contain.  The  results  indicate 
that  the  pilots  desire  a  color  araphic  display  which  presents  at  a  minimum  the 
ranqe,  altitude  and  bearinq  of  t.au  based  intruder  aircraft.  The  altitude 
requested  was  relative  to  the  own  aircraft-  however,  absolute  altitude  was 
not  used  in  the  test.  A  previous  study  (111,  which  had  the  pilot,  use  absolute 
altitude  and  not  relative,  reported  exactly  t.he  opposite  findinos.  These 
results  suqoest  that  t.he  pilots  can  use  either  presentation  and  are  happv  with 
the  one  most  familiar  to  them. 
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Nature  of  stimuli 

Response  time 
(sec) 

Test  conditions  and  results 

Visual 

12.12 

T racking  task;  no  impact  on  concurrent  tracking 

Visual  and  buzzer 

4.02 

Visual  and  voice 

2.40 

task  performance 

Visual  and  buzzer 

4.57 

Visual  and  voice 

1.94 

Visual  and  tone 

9.35 

Tracking  task;  better  tracking  with  voice  warning 

Visual  and  voice 

7.89 

Visual  and  buzzer 

2.63 

Visual  and  voice 

1.62 

Visual 

128.27 

Voice 

3.03 

High-speed,  low-level  military  flight  tests 

Visual 

44.05 

Visual  consisted  of  analog  instruments  and  lights 

Voice 

2.93 

in  an  F- 100  aircraft 

Auditory 

2.2 

Visual 

2.7 

Simulation  of  a  typical  cockpit  environment 

Voice 

1.94 

Buzzer 

2.57 

Tone 

9.35 

F-1 1 1  simulator;  each  alert  consisted  of  a  master 

Voice 

7.89 

caution  light,  alert  identification  light,  and  aural 
annunciation  of  the  type  described  to  the  left 

Tone,  voice,  and  visual 

5.0 

Tone  and  visual 

6.0 

Voice 

5.9 

Simulation  of  electronic  cockpit  environment 

Tone  and  voice 

6.3 

Visual3 

7.6 

Visual6 

6.0 

aVisual  presented  outside  pilot's  primary  field  of  view. 

^Visual  accompanied  by  a  master  alert  in  the  pilot's  primary  field  of  view. 


Figure  5.0-1.  Typical  Response  Times  as  a  Function  of  Display  Type 


67  &  68 


6.0  TCAS  CANDIDATE  SYSTEM  DESCRIPTION 


The  final  step  of  the  developmental  simulation  was  to  identify  the  TCAS 
display  configuration  which  would  be  used  not  only  in  the  operational 
simulation  but  also  in  future  flight  tost  proqrams.  Tn  order  to  perform  this 
task  it  was  necessary  to  review  the  TCAS  and  crew  alertinq  data  bases  and 
utilize  the  relevent,  information.  The  literature  (?,T, 6,7,8  ,]  ] )  ,  test  results 
and  the  pilots'  subjective  input.  (Section  A!  were  used  to  identify  the  actual 
display  characteristics.  Tn  the  operational  simulation,  the  recommended 
display  confiourat.ion  will  be  implemented  in  simulation  hardware  and  validated 
while  testino  various  operational  procedures. 

6.1  System  Desiqn  Objectives 

A  number  of  desiqn  objectives  were  used  in  identifyino  the  characteristics  and 
Ionic  of  the  displays  recommended  for  TCAS.  A  major  objective  was  to  define  a 
minimum  set  of  information  required  bv  the  system  and  relate  that,  information 
to  displays  which  are  anplicahle  not  only  to  advanced  fliqht.  decks  which  have 
an  inteqrated  alertinq  system  but.  also  to  conventional  flioht  deck  which 
requires  dedicated  alerts.  Tn  this  framework,  there  was  a  dpsire  to  develop 
an  efficient  and  effective  display  configuration.  Presentation  of  the 
information  should  minimize  the  time  for  the  fliqht  crew  to  dptoct,  assess, 
and  respond  to  the  alerts.  Information  processino  and  memorization  capabilit¬ 
ies  should  be  kept,  as  low  as  possible.  All  displays  and  alert  loqic  should  be 
guided  by  the  quiet  dark  cockpit  philosophy.  Finally,  distraction  and  startle 
effects  should  he  minimized  to  reduce  disruoture  of  aircraft,  control. 

6.7  TCAS  Display  Conf i nurati on 

One  of  the  major  objectives  of  the  developmental  simulation  was  to  define  the 
recommended  display  confiourat.ion  for  implementation  in  subsequent  phases  of 
the  TCAS  effort. 
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In  order  to  display  TCAS  information,  two  levels  of  alert,  urqency  shoul'1  be 
used: 


o  Warninq  -  Resolution  Advisory  -  situations  that  require 
immediate  corrective  action. 

o  Caution  -  Traffic  Advisory  -  situations  that,  require  immediate 
crew  awareness. 


As  a  minimum  these  levels  should  he  reflected  in  the  combination  of  system 
components. 

Three  primary  disolay  components  were  identified,  a  master  caution  (TAl,  a 
master  warninq  (RAl  and  resolution  advisory  display  (both  visual  and  voice). 
These  components  may  he  combined  as  follows: 

o  Master  Alerts 

o  Unique  caution  sound  and  amber  annunciator  as  the  traffic 
advisory  (TA). 

c  Unique  warninq  sound  and  red  annunciator  for  the  resolution 
advi sory . 

o  Resolution  Advisory  Displays 

o  Visual  display  providino  information  available  on  fhp 
modified  IVSI 

o  Voice  alert,  with  information  equivalent  to  the  visual 
display  and  continuous  until  cancelled 

The  presentation  of  traffic  information  on  a  CRT  display  is  also  a  method  of 
prosentinq  the  caution  level  alerts.  However,  before  this  type  of  display  is 
recommended  for  inclusion  as  a  necessary  component  of  the  TCA^  system,  further 
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t.est.inq  should  be  conducted  to  assess  its  impact  on  the  total  aircraft  system. 
Therefore,  it  is  recommended  that  a  CRT  disolay  prpsentino  a  color  araphlc 
representation  of  traffic  position  and  containing  at  least  hearinq,  altitude, 
horizontal  separation  and  vertical  direction  information  for  each  intruder,  he 
included  in  follow-on  test  pf forts  to  nrovide  this  assessment.. 

The  followinq  sections  will  present  some  of  the  ma.ior  characteristics  of  the 
system  components.  A  more  comprehensive  description  of  component,  characteris¬ 
tics  and  the  basis  upon  which  they  were  recommended  can  he  found  in  the  desiqn 
quidelines  from  the  Aircraft.  Alertino  Systems  Standardization  Study  (?\ . 

A.?.1  Master  Alerts 

The  master  alerts  are  used  to  attract,  thp  attention  of  the  crew  and  providp 
preliminary  information  about  the  urqency  of  the  alert..  In  the  TCAS  system 
only  two  levels  of  intruder  alerts  have  been  recommended,  warninq  (resolution 
advisory)  and  caution  (traffic  advisory).  The  master  alert.  shou1d  ho  unique 
for  each  level.  Due  to  the  attention  qettinq  qualities  of  these  alerts,  they 
may  become  a  distraction  once  they  have  performed  +boir  function.  Therefore, 
they  should  hp  manually  cancellable  and  should  also  cancel  automatically  when 
the  situation  no  lonqer  exists. 

It  is  further  recommended  that  both  visua1  and  aural  alerts  be  used  to  qet  the 
crews  attention  so  that  the  system  will  be  effective  under  the  maiorit.y  of 
workload  and  environmental  conditions. 

Master  visual  alerts  should  be  provided  for  each  ot  thp  crow  members.  The 
location  of  the  alerts  for  the  captain  and  first  officer  should  bo  within 
fifteen  deqrees  of  each  one's  centerline  of  vision  ( sep  Fiourp  A.?. 1-1)  both 
head-up  and  head  down.  This  is  known  as  tho  primary  field  of  view  and  has 
been  defined  as  follows: 

o  Head-up  -  centerline  of  vision  is  a  line  from  the  eye  reference 

point  in  the  aircraft  extendino  forward  aporoximatpl y  t.pn  deorees 
be!  ow  hori zontal . 
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Head-down  -  centerline  of  vision  is  a  line  extending  from  the  eye 
reference  point  to  the  center  of  the  Ani. 


Usinq  these  definitions  will  Diace  the  master  visual  alerts  on  or  near  the 
qlareshield.  The  master  visual  alerts  should  subtend  at  least  one  square 
deqree  of  visual  anqle.  The  liqht.ed  portion  of  the  alert  should  be  colored 
with  amber  beinq  used  for  the  traffic  advisory  (caution)  and  red  heinq  used 
for  the  resolution  advisory  (warnino). 

On  conventional  fliqht.  decks,  discrete  annunciators  should  be  used  tor  the 
TCAS  masters.  The  leaend  "TCAS*  should  be  clearly  visual  on  all  the 
annunciators.  For  fliqh+  decks  that  have  an  intearated  alertina  system  with  a 
comprehensive  centrally  located  visual  information  display,  the  existinq 
master  wa<-ninq/caut.ion  annunciators  should  be  utilized  with  a  "TCAS"  messaqe 
output  on  the  information  display. 

A  different  master  aural  alert  should  be  used  for  each  uroency  level.  The 
sounds  teat  are  chosen  should  he  desianed  t.o  most  effectively  penetrate  the 
noise  spectrum  in  the  cah.  The  intensity  should  be  set  at  R+  3  dB  at»ove  the 
masked  threshold  and  he  held  at  that  level  hy  usinq  automatic  pain  control. 

So  that  the  crew  can  quickly  recoqnize  the  sounds  and  voice  as  heinq  qenerated 
by  the  alertina  system,  they  should  be  perceptually  separated  from  competinq 
sound  sources  (e.a.  ATC,  around  communication,  ptc . ) .  The  sounds  should  be 
selected  to  reflect  the  alert  uraencv  level.  In  order  to  do  this  t.he  sounds 
should  have  the  followinq  charar tor i st i r s : 

0  Caution  Sound  (TA) 

steady  sound  composed  of  at  least  two  fremiencies 
between  inn  and  icon  Hz. 

sound  duration  between  1.?  and  ?.0  seconds 

sound  should  repeat  pvery  B  to  1?  seconds  until  cancelled 
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Warning  sound  f RA ) 


sound  consisting  of  t.wo  alternating  frequencies 
(European  siren)  in  the  400  to  1000  Hz  range  separated 
hy  at  least  300  Hz. 

each  frequency  should  be  on  for  0.?  to  0.3  seconds 
before  alternating  to  the  other 

master  warning  should  be  active  tor  0.7C  seconds  before 
switching  to  voice 

a  silent  time  ot  0.1F  to  O.R  seconds  should  be  provided 
between  the  sound  and  voice 

Figure  b.?.l-?  provides  a  qraphic  presentation  of  sample  master  alerting 
sounds. 

b.?.?  Resolution  Advisory  Displays 

The  resolution  advisory  alert  meets  the  qualifications  of  a  "time-critical" 
alert,  set.  forth  in  the  alerting  system  design  guidelines  (?).  The  purpose  of 
any  time-critical  display  is  to  provide  the  crew  with  direct  cues  for  res¬ 
ponding  to  the  hiqhest.-urqency  level  ot  warninq.  Therefore,  recommendations 
for  the  presentation  of  alert  information  on  the  RA  displays  should  follow 
those  guidelines. 

The  resolution  advisory  will  use  both  the  auditory  and  visual  channels  to 
provide  the  pilots  ouidance  for  resolvinq  the  conflict.  The  information 
provided  should  be  designed  to  Facilitate  t.be  rapid  detection  and  performance 
of  the  appropriate  response. 

A  visual  resolution  advisory  display  should  be  provided  for  both  the  captain 
and  first  officer.  The  displays  should  hp  located  within  each  pilot's 
head-down  primary  field  of  view.  This  recommendation  is  consistent,  with  the 
findings  of  Cooper  (b)  which  state  "the  most,  urgent,  warnings  should  he  located 
adjacent  to  the  controls  and  displays  involved  in  alleviating  the  warning". 
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He  further  stated  that  "warninqs  related  t.o  aircraft,  control,  such  as  "PULL 
UP"  should  he  located  adjacent  to  the  instruments  that.  tbe  pilot  is  usinq  such 
as  the  AOI  or  IVSI".  These  findinqs  are  also  consistent,  with  the 
recommendation  that,  the  RA  display  have  vertical  speed  as  an  inteqral  part,  of 
its  information.  The  display  should  provide  the  Dilot.  qui dance  as  to  the 
correct  action.  The  most  effective  way  to  Drovide  the  information  has  been 
found  to  he  qraphic  usinq  color  to  connote  urgency.  Care  must  he  used  in 
developinq  any  qraohic  scheme  so  that  the  format  is  easily  understood.  An 
arrow  should  he  used  to  oive  the  direction  of  any  vertical  maneuvers.  if  the 
RA  imposes  a  limit  on  a  maneuver  already  in  progress,  bars  or  other  types  of 
indexes  should  he  in  conjunction  with  the  vertical  speed  indicator  tp  show  the 
limits.  These  limit  bars  should  extend  down  to  zero  feet  per  minute.  In  hoth 
of  these  cases  the  alert  calls  for  immediate  action  hy  the  crew  and  thus 
should  bp  coded  red.  The  visual  RA  display  should  remain  active  until  the 
alertipo  situation  no  lonqer  exists  and  then  cancel.  As  with  any  other  fight 
instrument,  the  RA  display  should  provide  the  crew  with  some  indication  when 
it.  has  failed.  Two  types  of  failure  have  been  identified  for  consideration, 
hardware  and  looic.  System  hardware  failures  should  be  identified  on  the 
display  by  a  physical  indication  to  the  crew  (e.q.,  flaqs,  lights,  bars,  etc.) 
that,  the  system  is  not  operative.  If  the  aircraft  has  an  integrated  alerting 
system,  a  message  should  also  appear  on  thp  visual  information  display.  The 
second  failure  type  occurs  when  an  RA  condition  exists  but  the  loaic  cannot 
provide  quidance  for  that  particular  situation.  In  this  case  the  crew  needs 
to  know  that  they  are  in  an  RA  situation  but  it.  must  bp  very  clear  that  the 
system  cannot  give  guidance.  One  way  to  accomplish  this  would  bp  to 
illuminate  all  the  liqht.s  on  the  display. 

The  voice  display  for  thp  resolution  advisory  should  reoeat  the  information 
provided  on  thp  visual  display.  Because  of  the  time  critical  naturp  of  the 
alert,  t.he  voice  messaqe  should  be  activated  automatically  after  a  0.75  second 
presentation  of  the  warninq  sound.  The  alertinq  sound  and  essential  elements 
of  the  voice  messaqe  should  be  conveyed  within  R.5  seconds.  The  message 
should  repeat  until,  1)  the  pilot  cancels  it.  manually  7)  the  alert.ina 
situation  no  lonaer  exists  or  T)  the  messaqe  changes.  In  each  of  these  cases 
the  messaqe  should  complete  then  discontinue.  In  case  three  the  new  messaqe 
would  he  preceded  hy  the  warning  sound.  The  voice  message  should  he  presented 
in  a  monotone  with  an  intensity  that  is  R+  dB  above  the  ambient  nois°. 
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6.2.3  Traffic  Information  Display 


The  test,  data  indicate  that  the  information  increase  resultinq  from  a  CRT 
traffic  information  display  used  for  the  TA  can  increase  the  pilot  response 
times  to  the  time-critical  resolution  advisory.  Therefore,  care  must  be  used 
in  developing  procedures  with  a  TCAS  dispaiy  system  that  includes  this  tyne  of 
display.  However,  since  the  developmental  simulation  tested  the  CRT  display 
only  with  respect  to  its  affect  on  the  resolution  advisory  response  time, 
including  the  pilots  anticipation  of  the  response,  it  is  recommended  that 
further  testinq  be  conducted  with  a  color  graphic  presentation  of  traffic 
information  to  assess  its  impact  on  the  use  of  TCAS  and  on  the  operation  of 
the  aircraft  as  a  whole. 

For  testinq,  the  display  should  present,  traffic  information  graphically  usino 
color  to  portray  the  urgency  level  of  each  individual  aircraft.  The  number  of 
aircraft,  present  on  the  screen  should  be  limited  to  a  manaqeable  number.  Data 
has  shown  that  three  aircraft,  on  the  screen  at.  any  onp  time  should  be  a 
maximum.  The  util  iziat.ion  of  the  display  should  conform  to  the  auiet  dark 
cockpit  philosophy  which  calls  for  alert.inq  displays  to  be  dark  whpp  every¬ 
thing  is  normal .  When  the  display  is  active,  the  symbology  should  move 
smoothly.  Update  rate  should  be  increased  or  some  smoothing  function  applied 
t.o  the  symbols  to  keen  them  from  iumoinq. 

Care  should  be  taken  in  developing  +he  qranhic  presentation  so  that,  the  dis¬ 
play  can  be  easily  interpreted  and  the  symbology  does  not  conflict  with 
symbology  already  present  on  fhe  fliqht  doCk.  The  own  aircraft  symbol  should 
he  centered  horizontally  and  located  toward  the  bottom  of  the  screen  to  allow 
for  faster  head-on  closure  rates.  The  symbol  should  be  consistent,  with  other 
displays  such  as  EHSI  or  HUD.  At  least,  one  range  ring  should  be  provided  to 
qive  the  pilot,  some  sense  of  distance  to  the  traffic.  The  symbol  representing 
traffic  should  be  distinctly  different  from  the  own  aircraft  and  it  should 
change  color  with  respect  to  its  danqer  to  the  own  aircraft..  Altitude 
associated  with  each  traffic  symbol,  if  known,  should  he  displayed  in  the  same 
color  as  the  traffic  symbol .  This  altitude  may  be  given  in  either  absolute  or 
relative  to  the  own  altitude.  If  absolute  altitude  is  given  for  the  traffic, 
the  own  aircraft  altitude  should  also  be  presented  on  the  display.  Finally, 


associated  with  the  traffic  should  he  some  indication  of  vertical  motion.  Tf 
the  traffic  is  non-mode  C  equipment.,  some  indication  (i.e,  question  marks! 
should  he  used  in  place  of  the  altitude  to  show  the  crew  that  no  altitude  is 
available. 

If  surroundinq  non-tau  based  traffic  is  to  be  displayed,  it  should  he  avail¬ 
able  durinq  the  TA-RA  sequence  only  to  conform  to  the  quiet,  dark  cockpit.  If 
should  also  be  color  coded  with  a  color  other  than  red  or  amber. 

6.3  Follow-on  Verification  and  Evaluation 

Phase  II  of  the  study,  the  Onerational  Simulation,  will  have  as  i*s  ohiectives 

o  Develop  and  evaluate  the  operational  procedures  associated  with 
CAS  alerts  under  hofh  normal  and  abnormal  fliqht  operations. 

o  Assess  chanaes  infliqht  deck  operation  associated  with  the  CAS 
al erts 

o  Assess  operational  procedures  as  related  to  ATC  control 

o  Assess  the  impact  of  TCAS  display  requirements  on  fliqht  deck 
systems  and  layouts 

o  Validate  the  display  concept,  in  operational  conditions 

Phase  II  will  complement  the  concept  TCAS  display  system  in  simulation  hard¬ 
ware  and  install  it  into  a  motion-base  simulator  with  full  operational  capa¬ 
bility.  The  appropriate  TCAS  software  will  he  implemented  to  orovidp  fidelity 
to  the  situation  and  to  make  the  findinns  more  qeneral izeahlp  to  actual 
operations. 
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APPENDIX  A 

TEST  FACILITIES 
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A.0  Simulation  Center  and  Hardware  Layout  and  Summary 


The  various  requirements  of  this  study  called  for  an  easily  ■'•econfiqurahip 
facility  in  which  several  fliqht  deck  systems  could  be  demonstrated ,  to^pr) 
and  evaluated  in  a  realistic  environment.  The  Kent  Visual  Fliqht.  Simulator  at 
the  Fliqht  Simulation  Center  was  chosen.  Located  in  a  flexible  pxperimenta1 
simulation  laboratory,  the  simulator,  called  the  Ri  u°  Cah,  was  modified  to 
represent  a  oeneric  wide  body  cockpit  conf i quration  with  a  workino  pilots 
station. 

The  cockpit  instrumentation  included  two  TCAS  advisory  displays,  a  TCAS 
advisory  annunciator  and  two  TCAS  alert iro  dev  - <  cs  U.FH  display  and  I'/SI  with 
directory  1  iqht.s) .  Several  comhi nations  r.t  the  TCAS  equipment  w°re  used  hut 
they  were  never  all  used  toqpther. 

An  external  visual  workload  was  provided  to  the  pilot  thr'-w.-qh  the  forward 
windscreens;  computer  controlleo  video  used  for  takeoff ,  t.arqet  location.  T,,e 
pilot  was  also  presented  alert.inq  aural  s ,  ai "  'raff  ,  control  commands., 
hackqround  communications,  and  enqir.e  an-:  .«w.  sounds . 

The  test  conductor  was  in  visual  and  vo ;  -e  onh;*  w  ')>  ■  •  •  -hroijqhqi,* 

the  tests  from  his  console.  This  console.  »  nailed  h-  'e-  e-duct-, r  +o 

interface  directly  with  the  main  computer  and  .  on  a  a'1  ,.;id‘o  and  video 
parameters.  Fiqure  A.'l-I  depicts  tt,e  ’a/mi*  o*  sHi,1  u  '.in  renter. 

A.l  Cockpit  Simulator 

The  Blue  Cab  had  a  hybrid  (elert.roni  -end  conventional  1  main  instrument  nanr1 
standard  center  console,  and  seats  for  the  nil  it  and  enni1pt.  Active  ft  iqht 
instruments  were  provided  for  the  pi 1 ot  on’v.  ’'runted  -n  a  hydrau1 ic  plat¬ 
form,  the  cah  was  positioned  towards  the  front  .  n>  oiec  tier  so  repp  sid.-T  nc  the 
lowered  platform.  This  placed  the  plot's  eye  reference  point  in  an  opt  inal 
relationship  with  respect  to  the  homi  -.oerirui  j  rp  ji',;fi  in  sr ewn.  Ibo 
projector  was  located  di ,  ert.l  y  above  the  pile*  an  -i  *  -,p  eye  reference  point  wa  ; 
ahout  eiqht.een  feet,  from  the  screen,  a  <  -  vie*  t  n».-  ri,.c,  Ojh,  -•  c. 
illustrated  in  Fiqure  A. 1-1. 
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Figure  A.0-1.  Kent  Visual  Flight  Simulation  Center 
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A.  1.1  Pilots'  I nst.rumentation 


The  Blue  Cab's  main  instrument,  panels,  supportinq  framework  and  giareshield 
was  desiqned  to  reoresent  a  qeneric  wide  body  commercial  aircraft.  The 
pilots’  instrumentation  consisted  of  raster  scan  CRT's,  standard 
electro-mechanical  instruments,  annunciators  and  switches.  A  (R  inchi  color 
Hitachi  CRT  was  used  for  the  EADI  and  it  was  driven  by  a  Roeinq  huil*  color 
qraphics  generator.  Advanced  system  alerts  were  presented  on  a  (5  inch)  color 
Hitachi  CRT.  A  Lpxidata  model  34D0  color  graphics  qenerat.or  was  used  to  drivp 
this  CRT.  A  (Q  inch)  black  and  white  CRT  used  to  display  enqine  instrument 
information  was  driven  by  a  Roeinq  built  bar  graphics  qenerat.or.  Refer  to 
Fiqurp  A. 1.1-1. 

The  servo  and  synchro  motors  of  the  el ectro-mechanica)  instruments  were  driven 
from  a  local  controller.  Digital  information  from  the  host  computer  was  fed 
to  the  controller.  The  controller  then  passed  it.  through  diqit.a1  to  analog 
and  digital  to  syncro  converters.  Discrete  input  cards  sampled  the  switches 
when  requested  by  the  host  computer. 

This  included  the  pilot  Response  Panel  switches  (Fiqure  A. 1.1-?).  Except  for 
the  "TCAS  ALERT"  and  master  Warning/Caution  switch  lamps,  all  lighted 
annunciators  w«re  driven  with  discrete  output  cards.  The  (amber!  "TCAS  ALERT" 
and  (red  and  amher)  warninq  and  caution  switches  were  controlled  by  a  TCAS 
audio-video  ( T A \ )  unit,  (Section  A.?.?). 

The  FAA  supplied  a  modified  IVSI  (wich  director  lamps!  which  is  discussed 
in  Section  A.?.h.  Two  different  CAS  Advisory  Displays  were  evaluated.  They 
were  mounted  in  the  center  console  forward  of  the  throttles  (Figure  A. 1.1-?). 
These  advisory  displays  are  described  in  Section  A.?.S. 

A.?  CAS  Simulation  Fquipment. 

The  CAS  Simulation  Equipment  was  desiqned  to  operate  as  an  inteqrai  subsystem 
to  the  Blue  Cab  with  only  two  interface  links  required  between  it  and  the  host 
computer  (Fiqure  A. ? . -1 ) .  This  design  made  it  possible  for  the  system  to  be 
checked  out.  before  installation,  eased  integration  and  checkout  in  the 
simulation  center,  and  will  permit  easier  installation  in  different  cockpit 
simulators  for  other  phases  of  this  study.  The  six  subunits  that  make  up  the 
CAS  equipment,  are  described  below. 
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Figure  A.  1 .1-2.  Internal  View  of  Blue  Cab 
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Figure  A.21.  CAS  Simulation  Equipment  Layout 
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A.P.l  BEU  Simulator  Unit 


In  a  TCAS  equiDped  aircraft.  Beacon  Electronics  Unit  (BEU)  will  inteqrate 
aircraft  performance  data  and  compare  it  aqainst  TCAS  interroqative  aircraft 
in  the  qenera)  vicinity.  If  an  intercept  with  one  or  more  aircraft  is 
predicted,  the  BEU  will  alert  the  fliqht  crew  with  an  advisory  and/or  time 
critical  warninq  device. 

An  actual  BEU  was  not  available  for  this  study  so  a  Bata  General  MicroNova  was 
used  to  simulate  some  of  the  BEU  functions.  The  MicroNova  had  3?k  bytes  RAM 
and  a  dual  flexible  disk  unit  for  proqram  and  data  storaqe.  Three  RS-23? 
serial  ports  and  one  16-bit  parallel  port  were  used. 

Much  of  the  BEU  active  loqic  was  not  needed  because  "canned"  intrusion 
scenarios  were  used.  For  this  reason  the  slower  and  less  powerful  MicroNova 
capably  supported  this  study. 

The  MicroNova  was  sionaled  from  the  host  computer  when  to  start  each  intrusion 
sequence  via  RS-P32  link.  Table  A.?. 1-1  lists  the  messaqes  sent  between  the 
host  computer  and  the  MicroNova. 

The  MicroNova  outDUt  to  the  Advisory  Disp1ay  RS-P3?  Port  throuqhout.  each 
simulation  run.  This  RS-232  port  was  connected  to  a  switchinq  box  that 
pennitted  the  test  conductor  to  select  the  AID  disDlay,  the  Smith/Collins 
display  or  no  advisory  display  at  all. 

The  2d-byte  messaqe  that  was  ouput  at  a  rate  of  once  per  second  (1  Hz)  could 
contain  information  on  up  to  three  intrudinq  aircraft  in  addition  to  own 
aircraft  performance  data.  Fiqure  A. 2. 1.1  depicts  the  advisory  messaqe  byte 
definition. 

When  a  PA,  TA  and/or  RA  alert  occurred  one  or  more  of  the  twelve  lines  from 
the  MicroNova  to  the  TCAS  Lamo  Driven  Unit  were  activated.  The  ten  least 
siqnificant  lines  corresponded  to  the  ten  TCAS/IVSI  director  lamps.  The  other 
two  lines  siqnaled  TA's  and  PA's.  Table  A. ?..  1.?  lists  the  valid  messaqe/bit 
combinations. 


Table  A.2. 1-1.  Summary  of  Host-to-BEU  Simulation  Unit  Message  Formats 


BYTE 


ORDER 

7  _ __0 


1 

A  5 

2 

BYTE  COUNT 

3 

SYSTEMTIME-hr 

4 

SYSTEMTIME-min 

5 

SYSTEMTIME-sec 

6 

AOA  STATUS 

7 

beu  PERFORMANCE 

8 

SIM  A/C  ALT-LS  BYTE 

9 

SIM  A/C  ALT-MS  BYTE 

10 

IVSI  BYTES  0 

11 

IVSI  BYTES  0 

12 

INTRDR  1  ID 

13 

INTRDR  1  RANGE 

14 

INTRDR 1  RANGE  RATE 

15 

INTRDR  1  REL  ALT 

16 

INTRDR  1  AOA 

17 

INTRDR  1  CAS  COMMAND 

18 

19 

SAME  AS  BYTES 

20 

12  TO  17 

21 

FOR 

22 

"  INTRUDER  2 

23 

24 

25 

SAME  AS  BYTES 

26 

12  TO  17 

27 

FOR 

28 

INTRUDER  3 

29 

Abbreviations: 


AOA 
SIM  A/C 
LS  BYTE 
MS  BYTE 
INTRDR 
CAS 

REL  ALT 


Angle  of  arrival 
Simufation  aircraft 
Least  significant  byte 
Most  significant  byte 
Intruder 

Collision  avoidance  system 
Relative  altitude 


BIT  NUMBER 


1 

2 

3 

4 

5 

6 

7 

8 
9 


1 

2 

3 

4 

5 

6 


HEADER 


ADVISORY  FOP 
INTRUDER  NO. 


1 

2 

3 

4 

5 

6 


ADVISORY  FOR 
INTRUDER  NO.  2 


1 

2 

3 

4 

5 

6 


ADVISORY  FOR 
INTRUDER  3 


Figure  A.2.  /- i. 
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Table  A.  2. 1-2.  Definition  of  Parallel  Data  Sen:  to  /  VS!  ana  7  A  l  by  Micro  Nova 


12  BIT  OUTPUT 

11  bit  0 

TCAS  MESSAGE 

i 

1 

\~ 

1 

1 

Resolution  «»d\ 

Number 

000000000000 

NO  VERTICAL  COMMAND 

! 

001000000000 

CLIMB-  MAX  RATE 

i 

000100000000 

DESCEND  MAX  RATE 

| 

2 

1X10011 110000 

ZERO  CLiMB 

•) 

j 

000011 100000 

CLIMB  LIMIT  GOO  tt/i  .r- 

4 

000011000000 

CLiMB  1  IMIT  1.000  ft  .'ms* 

j 

5 

ooooiqpeeooo 

Cl.  iM3  LIMIT  2.0. V)  *■  nihi 

000000001111 

ZERO  DESCt  ND 

000000000' 11 

DESCEND  LIMI  '■  500  i-.t  • 

i 

H 

00000000001 1 

DESCEND  t  IMIT  1  000  tt.m- 

9 

000000000001 

DESCEND  LiMIT  2,000  0  vm 

10 

0000000 11111 

CLIMB  FASTER  1  -IAN  500  tt . 

. 

1 1 

0000001 11111 

Cl  IMS  F ASTE  R  .  HAN  1  000  H  mm 

12 

000001 111111 

Climb  faster  than  2  000  ft/m  1 

]  3 

0000 1 1 1 i 1 000 

DESCEND  F  ASTER  THAN  500  ft  mm 

14 

000011111100 

DESCEND  FAS  if  f!  THAN  1  990  'i.-m  .. 

T5 

00001 1111110 

DESCEND  1  ASH  R  1  HAN  ,  000  it.  n, 

15 

000011111111 

3  AND  7 

j 

17 

00001 1101111 

4  '  isjr.  •; 

i 

18 

(wool  1001  1 1 1 

:>  AND  / 

i 

?Q 

0000100011 11 

l.  Ai.  A  7 

i 

20 

00001 11 10111 

1  "■  N'T  H 

000011100111 

•.  AND  8 

i 

12 

00001 1000111 

5  A ;  'J  i  j  8 

23 

000010000111 

6  AND  8 

i 

24 

000011110011 

3  AND  0 

1 

25 

000011100011 

4  AND  9 

2R 

00001 1000011 

5  AND  9 

i 

O  > 

00001000001 1 

b  AND  9 

i 

i 

2P 

ooooi  ii  loan 

3  AND  10 

i 

29 

00001 1 100001 

4  AND  10 

3;  : 

00001 1000001 

5  AND  10 

31 

000010000001 

G  AND  10 

i 

2 

000011011111 

5  AND  i  1 

33 

00001001 1111 

0  ANI :  i  1 

34 

000010111111 

b  A  M  l ;  ]  / 

! 

3  b 

000011 111011 

9  AND  M 

30 

000011 1 11001 

10  AN!.'  M 

3/ 

00001 1111101 

10  AND  15 

i 

3b 

010000000000 

’ CALJT  ’ON 

i 

..  ..  ..i  .  .  ...  i.  .  _ ... 

Th^  *on  1 01  least  oqn'l  .  ?r:  *>»T^  ,m*  4n«  RA  ;•••  1  f.l  r  ♦  1  A  .  di*  ■  i  i  *nr  PA  s 
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A.?.?  Lamp  Driver  for  TCAS/IVSI  and  TAV  Unit 


The  Lamp  Driver  was  was  mounted  in  t.hp  same  rack  as  the  MicroNova  and  the  TAV 
unit.  It  accepted  inputs  (I?  lines)  from  the  MicroNova  and  provided  hiqh 
voHaqe  drive  siqnals  for  the  28  vo)t  lamps  in  the  IVSI  and  the  hiah  voltaqe 
receivers  in  the  TAV  unit.  Switches  on  the  Lamp  Driver  qave  the  test 
conductor  the  option  of  out.put.inq  to  the  TCAS/IVSI  and/or  TAV  and  conductinn  a 
liqht.s  test  feature. 

A. 2. 3  TCAS  Audio-Video  (TAV)  Unit 

The  TAV  unit  functioned  as  an  alert  controller  in  this  study.  (Fiqure 
A .  ? .  3 . 1 1 .  A  Ziloq  ZR0  microprocessor  monitored  and  prioritized  incominq  TCAS 
alert  siqnals  from  the  MicroNova  (via  Lamp  Driver)  and  aircraft  system  alerts 
from  the  host  computer  (via  Warninq  and  Caution  control  console).  Table 
A.2.I.?  lists  valid  TCAS  alertinq  messaqes.  Only  three  types  of  system  alerts 
were  recognized  hy  t.he  TAV  unit;  Warninq,  Caution  and  Advisory. 

The  TAV  front,  panel  has  several  switches  for  splectinq  alertinq  options  and  a 
LCD  display  that  mirrors  the  status  of  the  IVSI  director  lamps,  Fiaure 
A.?. 3-7.  This  layout  qave  the  test  conductor  the  ability  to  easily  chanqe 
alertinq  arranqements  and  monitor  intrusion  runs. 

Three  alert.inq  tones  are  produced  hy  the  tone  qenerator;  warninq  =  European 
Siren,  caution  =  C-Chord  and  advisory  =  Sinqle  Chime.  These  tones  were  used 
for  TCAS  and  System  alerts.  The  C-Chord  had  a  9  second  cycle,  2  seconds  on 
and  7  seconds  off,  until  cancelled. 

The  speaker  enclosure  was  located  bphind  the  pilots'  riqht  shoulder,  Fiqure 
A.  1.1-2.  A  microphone  and  preamp  for  the  automatic  qain  control  were  also 
mounted  in  the  speaker  enclosure.  The  automatic  qain  control  was  SPt  un  to 
keep  the  aural  tones  about  RdB  above  the  ambient  noise.  The  "critical 
bandwidth"  monitored  was  IDO  to  2400  hertz. 
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SYSTEM  ALERTS  CAS  ALERTS  FROM 


VIA  MASTER 

CONTROL 

CONSOLE 


BEU  SIMULATOR 
UNIT 

(MICRONOVAl 


-J 

-3 

-j 

"3 


SELECTION 
SWITCHES  FOR 
ALERTING 
OPTIONS 


Z80CPU  WITH 
RAM  ANO  EPROM 


4  16-BIT 
PARALLEL  I 


IVSt  LAMP 
DECODER 


LAMP  DRIVERS 

1^Jltipletone~  1 
GENERATOR  j 


■*!! 


fcr 


LED 

TCAS  DISPLAY 


“4N 


5  CAS 


RJ 


LIGHTED  TCAS 
ALER  I  SWITCH 


J!  warning!}  LIGHTED  MASTER 
1  *  TUT  ION  Jj  W/C  SWITCH 


VOICE  SYNTHESI2ER 


,1 


POWER  SUPPLIES  FOR  j 
LAMPS  AND  LECVf  ; 


r 


VOICE/TONt- 
SPEAKER  WITH 
MICROPHONE 
FOR  AUTOMATIC 
GAIN  CONTROL 


RS  232 
CONTROL 


Figure  A.2.3-  /.  TCAS  Audio-  Video  (7 A  V)  Unit 


1 


TAV/IVSI  SIMULATION  WITH  10  ACTIVE 


•  Voice  alert  messages 

•  LEO  time-critical  display 

•  TCAS  alert  switch 

•  Light  test  switch 


Figure  A. 2.3-2.  TA  V  Front  Panel  Layout 
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A  National  Temi conductor  voice  synthesi  zpr  chip  was  used  to  produce  the  Trfts 
voire  messaqes  that  are  listed  in  Tablp  A. 2. 1.2.  The  individual  words  w ore 
stored  on  PROM's.  A  tofal  of  ?7 7  phrases,  tones  and  pauses  wprp  available. 

AM  recordings  wprp  donp  hy  National.  The  compl  pt.p  vocabulary  is  listed  in 
Table  A. 2. 1-1. 

The  two  liqhted  alprt.inq  switches  were  mounted  on  thp  nlareshield  as  shown  in 
fiqure  A. 1.1.1.  The  split  1  eqend  Master  Warninq/CauHen  and  TCAS  Alert 
switches  were  controlled  and  sensed  by  the  TAV  unit.  noth  switches  were  also 
monitored  by  the  host  computer. 

riour°  A. 2. .1-1  is  a  block  diagram  of  the  ■  r;,  !'CA'>  disnl  iy  unit.  Tho  TAV  unit 
sent  an  eiqht  hit  address  to  the  LEO  unit  o  display  the  l.t.0  imaoes .  The  h’  * 
maps  for  all  the  TCAS  qraphic  and  alphanumeric  displays  were  stored  on  PROM's 
in  the  LED  unit. 

A.7. A  FAA  CAT  Advisory  Display 

An  Airborne  Intel  1  iqent  Display  !  AID  •  and  requir'd  support  equipment  were 
supplied  by  the  FAA.  The  AID  was  .  m-.di  fied  i’.epdix  color  weather  radar 
displ  ay.  A  microprocessor  based  ont.-p/l  W  had  i  tc  program  stored  i».  PROM  .vd 
on  power-up  it  initialized  ana  assumed  Tabu1ar  t-'spliy  M-de .  This  AID  was 
only  used  in  tabular  mode,  F1  thou  t  :  *  ha1  some  qraphic  'anahilit.y.  A  mock 
diagram  of  the  AID  system  is  shown  >n  T’qU.-o  4 . 2 . 4  - 1 . 

The  AID  system  received  data  from  *ne  ’’  at  ion  uni  t  ( Micro  NOVA''  via 

RS  -2.12  line  runninq  at  ofton  baud  r  >♦»- .  ’>  ‘e-nation  was  transferred  to  tw.  A :  n 

in  formatted  data  blocks  of  up  to  2°  bit.  oyt.es  once  every  two  seconds.  ra,  * 
data  b’ock  heoan  with  a  sync  byte  v>d  -  fo' ’owed  by  nine  byte 

header  of  own  aircraft  status  and  Then  up  to  n.t-ee  advisory  data  blocks  of 
intruding  aircraft.  A  data  block  was  trancferr.."  t„  the  AID  every  two  second, 
whether  or  not.  advisories  were  present.  I*  ggv i so- i rs  were  not  present 
nothing  was  displayed  on  the  monitor.  Rpfrr  to  '■  inure  A. 2.4-2  for  AID  message 
byte  definition. 
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Table  A.2.3-1.  Voice  Vocabulary  List 


ONE 

Q 

DANGER 

HAVE 

NOT 

SLOWER 

TWO 

R 

DATE 

HEADING 

NOTICE 

SMOKE 

THREE 

S 

DAY 

HELLO 

NUMBER 

SOUTH 

FOUR 

T 

DE 

HELP 

OF 

SPACE 

FIVE 

U 

DECREASE 

HERTZ 

OFF 

SPEED 

SIX 

V 

DEGREE 

HIGH 

OHMS 

SS 

SEVEN 

w 

DEPOSIT 

HIGHER 

ON 

STAR 

EIGHT 

X 

DIAL 

HOLD 

ONWARD 

START 

NINE 

Y 

DIVIDE 

HOUR 

OPEN 

STATION 

TEN 

z 

DO 

IN 

OPERATOR 

STOP 

ELEVEN 

ABORT 

DOLLAR 

INCHES 

OR 

SWITCH 

TWELVE 

ADD 

DOOR 

INCORRECT 

OUT 

SYSTEM 

THIRTEEN 

ADJUST 

DOWN 

INCREASE 

OVER 

TEST 

FOURTEEN 

ADVISORY 

EAST 

INTRUDER 

PARENTHESIS 

TH 

FIFTEEN 

AGAIN 

ED 

IS 

PASS 

THAN 

SIXTEEN 

ALARM 

EMERGENCY 

IT 

PER 

THANK 

SEVENTEEN 

ALERT 

END 

JUST 

PERCENT 

THE 

EIGHTEEN 

ALL 

ENTER 

KEY 

PICO 

THIRD 

NINETEEN 

AMPERE 

ENTRY 

KILO 

PLACE 

THIS 

TWENTY 

AND 

EQUAL 

LEFT 

PLEASE 

TIME 

THIRTY 

ASK 

ER 

LESS 

PLUS 

TOTAL 

FORTY 

ASSISTANCE 

ERROR 

LESSER 

POINT 

TRAFFIC 

FIFTY 

AT 

EVACUATE 

LEVEL 

POUND 

TRY 

SIXTY 

ATTENTION 

EXIT 

LIMIT 

PRESS 

TURN 

SEVENTY 

BRAKE 

FAIL 

LOAD 

PRESSURE 

UP 

EIGHTY 

BUTTON 

FAILURE 

LOCK 

PULSE 

USE 

NINETY 

BUY 

FARAD 

LOW 

QUARTER 

UTH 

HUNDRED 

CALL 

FAST 

LOWER 

RANGE 

WAITING 

THOUSAND 

CANCEL 

FASTER 

MAINTAIN 

RATE 

WARNING 

MILLION 

CASE 

FEET 

MARK 

RE 

WATER 

ZERO 

CAUTION 

FIFTH 

MAXIMUM 

REACH 

WEIGHT 

A 

CENT 

FIRE 

MEG 

READY 

WEST 

B 

CENTI 

FIRST 

MEGA 

RECEIVE 

WINDOW 

C 

CHANGE 

FLIGHT 

METER 

RECORD 

YES 

D 

CHECK 

FLOOR 

MICRO 

REPLACE 

ZONE 

E 

CIRCUIT 

FLOW 

MILE 

REVERSE 

400-Hz  TONE 

F 

CLEAR 

FORWARD 

MILLI 

RIGHT 

800-Hz  TONE 

G 

CLIMB 

FROM 

MINUS 

ROOM 

20-ms  SILENCE 

H 

CLOSE 

FUEL 

MINUTE 

SAFE 

40-ms  SILENCE 

1 

COLLISION 

GAS 

MORE 

SECOND 

80-ms  SILENCE 

J 

COMMA 

GET 

MOVE 

SECURE 

160-ms  SILENCE 

K 

COMPLETE 

GO 

NEAR 

SELECT 

320-ms  SILENCE 

L 

CONNECT 

GOING 

NEED 

SEND 

M 

CONTINUE 

GRAM 

NEXT 

SERVICE 

N 

CONTROL 

GREAT 

NO 

SET 

0 

COPY 

GREATER 

NORMAL 

SIDE 

P 

CORRECT 

HALF 

NORTH 

SLOW 

A- 1 7 


Figure  A.2.4- 1.  Block  Diagram  of  FAA-Supplied  Airborne 
Intelligent  Display  ( AID /  System 
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BYTE  ORDER 
1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 
29 


BIT  NUMBER 


A  5 

BYTE  COUNT 

SYSTEMTIME  (hr) 

SYSTEMTIME  (mm) 

SYSTEMTIME  (sec) 

AOA  STATUS 

BEU  PERFORMANCE 

SIM  A/C  ALT  (LS  BYTE) 

SIM  A/C  ALT  (MS  BYTE) 

IVSI  BYTES— 0 

IVSI  BYTES-0 

INTRUDER-1  ID 

INTRUOER-1  RANGE 

INTRUDER-!  RANGE  RATE 

INTRUDER-1  RELATIVE  ALTITUDE 

INTRUDER-1  AOA 

INTRUDER- 1  CAS  COMMAND 


SAME  AS  BYTES 


12  TO  17 
FOR 


INTRUDER  2 


-4 


SAME  AS  BYTES 


i  r 
I 


12  TO  17 
FOR 

INTRUDER  3 


Abbreviations 

AOA 
SIM  A/C 
LS  BYTE 
MS  8VT fc 
INTRPR 
CAS 

RFL  ALT 


angle  c>!  ai  rival 
simulation  ,e  retail 
least  significant  byte 
most  significant  byn 
intruder 

collision  avoidance  systr. 
lelative  altitude 


1 

2 

3 

4 

5 

6 

7 

8 
9 
1 
2 

3 

4 

5 

6 
1 


Ftgu'e  A. 2.4-2  AID  Message  Byte  Definition 


HEADER 


ADVIbORY  FOR 
INTRUDER  1 


ADVISORY  FOR 
INTRUDER  2 


i 

I 

ADVISORY  FOR 
INTRUDER  3 
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A.?.*  GRAPHIC  CAS  ADVISORY  DISPLAY 


Graphic  CAS  advisories  were  presented  on  a  Collins  color  monitor  driven  by  a 
Smiths  color  qraohics  qenerator.  The  test  conductor  was  able  to  select 
between  two  qraphic  modes.  One  mode  was  identical  to  the  one  supplied  with 
the  FAA  AID.  The  other  was  an  advanced  qraphic  presentation. 

The  data  format  and  bus  to  the  Smiths  qraphics  qenerator  was  identical  to  the 
one  defined  in  Section  A. 2. 4. 

A. 2. 6  CAS/IVSI  UNIT 

An  Intercontinental  Dyanmics  Corporation  instantaneous  vertical  SDeed 
indicator  (IVSI)  modified  with  collision  avoidancp  system  director  lamps  was 
used  for  the  tests.  The  IVSI  analoq  syncro  needle  was  driven  by  the  host 
simulation  comouter  with  an  analoq  syncro  driver.  The  eiqht  "eye  brow"  lamps 
and  two  arrows  were  driven  by  the  BEU  simulation  unit.  Refer  to  Fiqure  A. 2-1. 

A. 3  SIMULATION  AUDIO  AND  VIDEO  SUPPORT 

A. 3.1  Simulation  Audio 


A  multiple  tape  player  audio  system  was  used  to  provide  specific  and  qeneral 
ATC  info iiiation  plus  aero  and  enqine  noise.  Fiqures  A. 3-1  and  A. -3-2  show  the 
audic  system  block  diaqram  and  equioment  arranqement. 

The  three  ATC  audio  cassette  players  and  aero-enqine  reel-to-reel  tape  player 
were  under  limited  control  of  the  host  computer  via  the  Master  Control 
Console,  Section  A. 3. 3.  The  aero-enqine  noise  and  ATC  background  audio  tapes 
could  only  be  started  and  stopoed.  The  ATC  special  and  ATC  TCAS  messaqes 
could  be  started  by  the  host  but  they  would  not  stop  until  the  host  siqnaied  a 
stop  and  an  end  of  message  signal  was  sensed  on  the  taoes  second  audio 
channel.  This  arranqement  allowed  the  host  computer  to  precisely  start  ATC 
messaqes.  The  tapes  would  stoo  at  the  end  of  one  messaqe  and  be  positioned  at 
the  start  of  the  next  one. 


CASSETTE  4 
TCAS  SPECIAL 


Equipment: 

Audio  cassette  1 
Audio  cassette  2 
Audio  cassette  3 
Audio  cassette  4 
Audio  reel-to-reel: 
Video  reel-to-reel . 
Equalizer. 

Mixer  1 
Mixer  2 
Mixer  3 : 


not  used 

ATC  special,  flightpatb  control 
ATC  background 
ATC  TCAS  messages 
aero  and  engine  noise 
not  used 

aero  and  engine  noise 
ATC  message  mixing 
not  used 

rmt  uteri 


Figure  A.3.1-2.  Audio  Equipment  Rack  Layout 
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All  t.he  ATC  audio  cassettes  outputs  were  mixed  and  amplified  hy  one  channp1  nf 
a  6fi  watt  per  channel  Morantz  amplifier.  A  microphone  input  for  the  test 
conductor  was  also  mixed  with  the  ATC  messaqes.  This  microphone  was  normally 
used  before  and  after  a  mission  scenario. 

The  aero-enqine  noises  were  output  on  separate  channels  from  the  reel -to- reel 
tape  player.  The  host  controlled  the  output  levels  of  channel  with 
proqrammahle  amplifiers.  The  proqrammabie  amplifiers  are  described  in  Section 
A.T.3.  An  Altec  Lansinq  audio  frequency  equalizer  was  used  to  shape  the  aero 
and  enqine  noises  to  make  them  more  realistic  soundino  After  the  equalizer, 
an  audio  mixer  was  used  so  that,  each  of  the  tWo  laroe  speakers  would  have  bote 
aero-pnqine  noises.  A  TOO  watt  per  hanne1  audio  amp1  i f ■> was  able  to  boost 
the  aero-enqine  noise  lev°ls  to  realistic  volumes. 

A.T.?  Simulation  Visual 

A  movinq  outside  visual  scene  was  projected  on  a  thirty  foot  diameter 
hemispherical  screen  in  front  of  the  cah.  Tns  sce-e  was  proiected  by  a 
black  and  white  projector  that  was  mounted  op  top  of  t.he  rah,  directly  over 
the  pilot's  head.  The  movinq  scones  were  provided  by  a  -  '•  rsed-ci rcui t.  wvi- 
camera  and  "canned"  visual  intrusions  on  a  video  cassette  player.  Fi aure 
A.T.2-1  shows  the  video  system  layout. 

Take-off  and  landinq  scenes  w°r°  qenorat.ed  with  the  c  l  os^d-ci  roui  t.  servo 
camera  scanninq  an  airport  model.  The  intruder  <(:<  nes  wp”p  prerecorded  on 
inch  video  cassette.  When  a  intrusion  sequence  was  to  start  t.hp  host  ■' ompet,,,- 
started  th°  video  player.  The  master  control  console  ha  i  circuitry  that  wn 
sense  the  end  of  the  scene  and  stop  the  tape. 
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a.t.o  Simulation  Audio  and  Video  fortro’ 


!  "•ntf'd  next  to  the  rsh,  on  the  main  floor  of  the  simul  ation  room,  thp  master 
conductor  console  provided  a  oood  vew  of  +he  proipction  screen,  the  pilot 
station,  and  the  audio  and  video  equipment.  Through  a  terminal  on  the 
console,  the  test,  conductor  controlled  the  simulation  host  computer  and  varie  • 
simulation  parameters.  An  intercom  system  permitted  communicati on  with  the 
hosf  computer  room,  thn  mode1  room,  and  the  cab.  The  console  layout  is  shown 
in  Fi mire  A. 3. 3-1 . 


The  audio  eouipment  rack  was  located  rv-x r  7  '•■a  .-or- sot  Most  n£  the  audio 

system  control  s  were  remotpd  to  the  consol  ,  and  ;,i-c  1  os«  proximity  of  the 
equipment  rack  afforded  easy  vi  u  ■  -'erf f’.: ation  ’f  ac  ions  taken.  T he  mart.’- 
conductor  console  had  an  intern  i!  ’h  >  i"«’  .bus  that  was  fed  from  a  ’fi-hit 
i  nterface  with  the  host .  This  irte  -  far  e  al  1  owed  the  host  compu  +  pr  tn  ni  me*  ’  ■. 
control  the  audio  players,  video  •  ■  iver,  three  'locks.  a«r o-enqine 
proqrammahlo  amplifiers.  l  +  a1  so  r.-^ovi  dpd  an  inter  far'-  with  the  TAV  uri  ♦ 
pass  aircraft  svstp""  alerts  °i  *  fin. .re  A/',  a-?  fo*  a  ol nek  diagram  of 
the  interface  hus.  The  device  t  n .  ?->rrc  ■"  ■■-’pric-.a  Help*. 


Dev’C.e  I  ntprfflcp  #1  Address  1 


Data  Line 


AHDR . 


0 

si  1  dp 

pro i O' ♦ v 

1  r pi  1 1  p-  _  hi  ah 

-  f-J(. 

ward,  1r,w 

1  - 

sl  i  de 
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Figure  A.3.3  1.  Master  Conductor  Console  Layout 


Device  Interface  #2,  Address  ?  (QQlOBl 


This  address  is  used  to  direct,  the  TAV  microprocessor  or  to  sound  the  alertino 
tones  and  liqht.  the  qlareshield  mounted  master  warni nq/caut.ion  switch.  Values 
are  latched  and  held  until  changed  by  host. 


Data  Line  -  0 

1 

2 

3 

4 
s 
7 
o, 
Q 

10 

11 

ADDR.  P 

n 

14 

11 


master  warninq  liqht,  hiqh  =  on,  low  =  off 
master  caution  liqht.,  hiqh  =  on,  low  =  off 
warninq  tone,  hiqh  =  on,  low  =  off 
caution  tone,  hiqh  =  on,  1 ow  =  off 
advisory  tone,  hiqh  =  on,  low  =  off 
0 
0 

M/C 

M/C 

N/C 

M/C 

0 

1 

0 

0 


Device  Interface  01,  Address  1  (001 1R) 


This  address  controls  the  Aero  and  Enqine  Moise  Proqrarnmahle  Amplifiers.  Aero 
uses  amp.  #1  and  Engine  uses  amp.  #2.  Values  are  latched  and  held  until 
changed  by  the  host. 


Data  Line  0 
1 
? 
.? 
4 
1 
1 
7 
« 

q 

in 

11 

l? 

n 

14 

15 


-  0 

-  0 

_  0 

-  0 
-  0 

-  0 

-  0 

-  0 

-  0 

-  0 


1 

1 

1 

1 

1  FULL  ON 
1 
1 
1 
1 
1 


Siqn  bit  -  set  low  always 

-  Amp.  Selection  -  hiqh  =  Amp  ?, 

-  1 
-  1 
-  0 
-  0 


low  =  Amp  1 
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A. 4  HOST  COMPUTER  AND  INTERFACING  EOllIPMFNT 


The  simulation  host  computer  was  comprised  of  three  Varian  V7S  computers 
operatinq  in  parallel.  A  nine-track  maqnetic  tape  system  was  used  to  record 
pilot  responses,  fliqht  parameters,  and  fliqht  data. 

All  simulation  equipment,  incltidinq  the  fliqht  instruments,  were  controlled  hv 
the  simulation  host  computer  throuqh  a  chainino  I/O  controller  (or  chain 
controller).  The  chain  controller  on  instruction  from  the  host  computer 
passed  data  to  selected  instruments  (or  hardwarpi  or  retrieved  data  from  ts-,-. 
simulator.  The  chain  controller  also  interfaced  with  the  test  conductor's 
console  and  the  model  room.  The  chairs  controller  cycled  at  a  rate  of  ?.r'  t 
10  milliseconds.  Maximum  usaqe  hrouqht  it  down  to  milliseconds  per  c  v  r 1  e  . 
Therefore,  the  maximum  delta  between  a  pilot's  or  fliqht.  enqineer's  action  jnd 
the  notation  of  that  action  was  approximately  one  one-hundredth  of  a  s-"~ond. 
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APPENDIX  B 

PILOT  TRAINING  CHECKLIST 


PILOT  BRIEFING  CHECKLIST 


INTRODUCTION 

1.  Backqround 

a.  This  is  an  FAA  prooram  that  develops  a  systematic  approach  to 
collision  avoidance  systems. 

h.  Thp  prooram  is  a  two-phase  effort,  this  is  the  first  phasp. 

c.  This  phase  evaluates  elements  of  the  potential  TCfiS 

alertinq  system. 

d.  Thp  second  phase  will  place  a  candidate  system  in  an 
operational  simulator. 

You  will  participate  in  these  tests,  as  well  as  the  operational 

tests.  Eventually,  a  system  will  qo  on  to  flios.t  test  ahoarn  an  f- 

T?7. 

?.  Phase  1  ohier.tives 

a.  Evaluate  Tr.A';  display  tprhnolooy  ''or  no+h  conventional  and 
electronic;  flipht  decks. 

h.  Validate  voice  only  as  a  viable-  command  display. 

c.  Determine  the  effect  on  the  pilots  response  performance  of 
addinq  threat  advise ry  alert/ s). 

d.  Evaluate  thp  effect  of  add-ino  rtnae  and  altitude  to  the  thm» 
advisory  information. 

°.  Fval uate  thp  effect  of  addino  hparinq  to  thp  threat  advisory 
i nformatinn . 

f.  lovesticiate  the  effect  of  prosenfinq  threat  advisories  which 
do  not.  empress  to  avoidance  maneuver  commands. 

flight  task 

1 .  Ac ti ve  di spl ays 

a.  FAD!  ,  HUH  (if  installed! 

h.  MSI  /f"1F /COljrse  army/ 


c.  Airspeed 

ft.  Altimeter 

e.  Vertical  speed/ resol uti on  advisory  display 

f.  Clock 

q.  Alert  displayi  si 

h.  Enqine  instruments 

i.  Flaps 

i.  17  key 

k.  LED  resolution  advisory  display 

l.  AID  traffic  advisory  display 

m.  CRT  traffic  advisory  display 


2. 


3. 


4. 


Active  controls 

a .  Wheel  and  col  umn 

b.  Rudder  and  toe  brake 

c.  Speed  brake 

d.  Flaos 

e.  Gear 

f.  Fire  bandies 

q.  Response  switches 

h.  I?  key 

i.  Throttles 

Fliqht  path 

a.  Takeoff 

b.  Climb-cloud  layer  -  VFR  on  top 

c.  Cruise 

d.  Descent-cloud  layer  -  JW  ceilinq 

e.  Land 

f.  Turns 

q.  Autothrottle 

h.  Windshear 

i .  Updates 

ATC 

a.  Fliqht  path  direction 

b.  Traffic  annunciation 
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Til.  CREW  ALERTING 


1.  Advanced  system  displays 

a.  Information  (systems/AID/CRT) 
h.  Master  visual 

c.  Master  aural 

d.  Voice  alerts 

e.  Time  critical  ILED/IVSI) 

f.  EADl/HUD  chanqe 

Conventional  system  display  (not  used  in  this  test) 

a.  Distributed  alerts 

b.  Annunciator  panel 

c.  Discrete  tones 

T.  Alert  response 

a.  Flight  management  responses 

b.  System  management  responses 

c.  Collision  avoidance  responses 

4.  Review  alerts  and  responses 
IV.  TRAINING  FLIGHTS 

1.  Airplane  famil iari zation  Flight 

a.  Review  handlinq 

b.  Introduce  ATC  qui dance 

c.  Familiarization  with  f1iqht  P'an 

d.  Familiarization  with  visual  encounters 

2.  TCAS  system  familiarization 

a.  Rpyiew  possible  alerts 

b.  Revipw  responses 
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APPENDIX  C 

POST  FLIGHT  QUESTIONNAIRES 


POST -FLIGHT  QUESTIONNAIRE  fIVSI) 


Please  complete  the  following  questions  with  respect  to  the  BCAS  configuration 
that  you  flew  with  on  your  last  fliqht.  Use  the  Comments  section  freely  since 
your  input  is  important  to  the  development,  of  useful  recommendations.  Also 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TCAS  configuration. 

Pilot: _ Date: _ 

TCAS  Configuration: _ _ 


1.  In  qeneral ,  were  the  actions  required  hy  the  commands  dear  and 
unambiguous? 


Comments : 


Always  Usually  Sometimes  Seldom  Never 

7S%  ?S% 


2.  Did  the  use  of  colors  help  in  interpreting  the  command  display7 

Very  much  Some  Very  little  None 

33%  42%  17%  R% 


Comments : 


3.  Did  the  modification  of  the  IVSI  by  addition  of  command  lights  detract 
from  the  primary  purpose  of  the  instrument7 


YES 

R% 

Comments : 


NO 

Q2% 
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4.  Did  the  command  display  contain  TOO  VUCH  or  TOO  LITTLE  information;  that 
is,  was  the  disolay  too  busy  or  not  informative  enouqh7 

About  riaht  R3% 

Add  the  following:  How  much  and  how  fast,  use  TCAS  light,  more 


Delete  the  following: 


Comments : 


5.  Did  the  display  and/or  command  cause  you  to  make  larger  than  normal  (,?SG 
to  l non  fom)  vertical  accelerations? 


A1 ways 

Usual ly 

17% 

Sometimes 

SO 

Sel dom 

R% 

Never 

?S% 

Comments : 

6.  Did  the  master  alert(s)  enhance  or  detract,  from  system  effectiveness? 


Great.l  y 

Enhance 

No 

Detract 

Greatl y 

Enhance 

Effect 

Detract. 

17% 

S0% 

?S% 

R% 

Comments : 


In  the  space  below  please  describe  any  difficulties  you  had  durinq  the  flight 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  give  any  overall 
comments  on  the  TCAS  display! si  and  information  presentation. 


C-4 


POST -FLIGHT  OIIF.SHOUNAIRE  (LEOl 


Please  complete  the  followinq  questions  with  resnect  Lo  the  RCAS  conf i aurati on 
that  you  flew  with  on  your  last  flight.  Use  the  Comments  section  freely  since 
your  input  is  important  to  the  development  of  useful  recommendations.  Also 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TCAS  conti qurati on . 


Pilot :  Oa+e: 

TCAS  Conf iqurati on :  _  _ 


1.  In  general,  were  the  actions  required  hy  the  commands  clear  and 

unambiguous’ 


A1 ways 

Usual  1  y 

Someti mes 

Sel  Horn 

Never 

?S'V 

SO 

m 

M 

Comments:  Limit  Commands  difficult  to  read 


2,  Did  the  use  of  colors  help  in  interpretino  the  command  display? 


Vnry  much  Some 
17"  66* 


Very  little  None 

vr 


Comments : 


3.  Did  the  command  display  contain  TOO  MUCH  or  TOO  LITTLE  information;  that. 
Is,  was  the  display  too  busy  or  not.  informative  enouqh? 

About  right  42% 

Add  the  following:  A%  add  rate  information 


Delete  the  following:  50%  too  busy,  make  graphics  more  simple 


Comments: 


A.  Did  the  disolay  and/or  command  cause  you  to  make  larger  than  normal  (  .?5G 
to  1000  fpml  vertical  accelerations7 

Always  Usually  Sometimes  Seldom  Never 

_  _8%  75%  _  17% 

Comments: 


5.  Did  the  master  alert! si  enhance  or  detract  from  system  effectiveness? 


Great.1  y 

Enhance 

No 

Detract. 

Greatl y 

Enhance 

Effect 

Detract 

17% 

fm 

Comments: 


In  the  space  below  please  describe  any  difficulties  you  had  durinq  the  fliqht 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  qive  any  overall 
comments  on  the  TCAS  display! si  and  information  presentation. 


I 


POST-FLIGHT  QUESTIONNAIRE  (VOICE) 


Please  complete  the  foil  owl  nq  questions  with  respect,  to  the  TCAS  conflquratlon 
that  you  flew  with  on  your  last  fllqht.  Use  the  Comments  section  freely  since 
your  input  is  important  to  the  development  of  useful  recommendations.  Also 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TCAS  confiquration. 

Pilot: _ Date: _ 

TCAS  Confiquration: _ 


1.  In  general,  were  the  actions  required  by  the  commands  clear  and 
unambiguous? 

Always  Usually  Sometimes  Seldom  Never 
50%  50* 


Comments:  Without  visual,  voice/should  stay  on  until  problem  is  saved. 


?.  Did  the  command  display  contain  TOO  MUCH  or  TOO  LITTLE  information;  that 
is,  was  the  display  too  busy  or  not  informative  enough? 

About  right  ?5% 

Add  the  following:  75%  voice  should  stay  on,  need  visual 


Delete  the  following: 


Comments : 
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3.  Were  the  voice  alerts  ever  interfered  with  by  other  communication? 


Always  Usually  Sometimes  Seldom  Never 
_  _  33%  m  50% 

Comments : 


4.  Did  the  display  and/or  command  cause  you  to  make  laroer  than  normal  (.?5G 
to  1000  fpm)  vertical  accelerations? 

Always  Usually  Sometimes  Seldom  Never 

.  25%  50%  R%  17% 

Comments: 


Did  the 

master  alert(s) 

enhance  or 

detract  from 

system  effectiveness7 

Great! y 

Enhance 

No 

Detract 

Grea+ l y 

Enhance 

Effect 

Detract. 

17% 

50% 

17% 

m, 

R% 

Comnents 


In  the  space  below  please  describe  any  difficulties  you  had  durlnq  the  fliqht 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  qlve  any  overall 
comments  on  the  TCAS  displayfs)  and  Information  presentation. 
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POST -FLIGHT  QUESTIONNAIRE  (CURRENT  GRAPHIC) 


Please  complete  the  followinq  questions  with  respect  to  the  TCAS  confiquration 
that  you  flew  with  on  your  last  flioht.  Use  the  Comments  section  freely  since 
your  input  is  important  to  the  development,  of  useful  recommendations.  Also 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TCAS  confiquration. 


°ilot: _ Date: 

TCAS  Confiquration: 


1.  Were  the  traffic  advisories  presented  in  time  to  he  effectively  used7 

Always  Usually  Sometimes  Seldom  Never 

hn  w  _  _  _ 

Comments : 


2.  Were  the  traffic  advisories  as  useful  as  current  ATC  traffic  advisories’ 


More  About  Seldom  Never 

useful  as  useful  as  useful  as  useful 

6A»  27a;  Q* 


Comments : 


C-ll 


FT"  ■ 

3.  How  did  the 

advisories  affect  your  workload 

as  compared 

1 

i 

i 

to  current  ATC 

advl sorles? 

Unacceptable 

Acceptable 

No  effect 

Small 

Larqe 

increase  In 

increase  in 

on  workload 

decrease 

decrease 

workload 

workload 

in  workload 

in  workload 

— 

73% 

9% 

9% 

9% 

t 

Comments:  Much  easier  than  tabular 

,  lookinq  at 

screen  breaks 

up  scan 

4.  Do  you  feel  the  threat  display  would  help  you  locate  traffic  you  would  not 
normally  see? 


AT  ways 

Comments : 


Usual  1 y 
64% 


Sometimes 

36% 


Sel  dom 


Never 


5.  Do  you  feel  that  the  master  caution  alert  was  necessary  to  draw  your 

attention  to  the  threat  display? 


Always  Usually  Sometimes 
27%  66%  18% 

Comments: 


Seldom  Never 


Always 

27% 

Comments: 


Was  the  qraphic  format  clear  and  unambiquous? 
Always  Usually  Sometimes  Seldom 


Usually 

66% 


Sometimes 

18% 


Never 
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7 


Was  there  too  much  or  too  little  information  provided  by  the  qrapbic 
format? 


About  riqht  7T7 

Add  the  fol  1  owi nq :  77?,  system  accuracy,  predicted  track 


Delete  the  foil  owi  no: 


Comments :  Suggest  use  of  another  symbol  for  the  intruder  because  the  triangle 
seems  to  indicate  direction  of  movement 


A.  Did  the  use  of  color  in  the  display  aid  you  in  interpreting  the 

message’ 


» 

Very  much 


Comments : 


Some 

q* 


Very  little 
7  3% 


None 


q.  Were  you  able  to  us»  the  qrapbic  presentation  of  the  traffic 

advisories  to  anticipate  the  evasive  maneuver? 


Always 

Usually 

Sometimes 

Sel dom 

Never 

q% 

Comments : 

W 

?ir 

or 

— 

In  the  space  below  please  describe  any  difficulties  you  had  durino  the  fUqht 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  qlve  any  overall 
comments  on  the  TCAS  display! si  and  Information  presentation. 


( 
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POST -FLIGHT  QUESTIONNAIRE  (NEW  GRAPHIC) 


Please  complete  the  following  questions  with  respect.  t.o  the  TCAS  configuration 
that  you  flew  with  on  your  last,  fliqht.  Use  the  Comments  section  f reply  since 
your  inout  is  important  to  the  development  of  useful  recommendations.  Also 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TEAS  configuration. 


Pilot: _ Date: 

TCAS  Configuration: 


1.  Were  the  traffic  advisories  presented  in  time  to  he  effectively  used? 
Always  Usually  Sometimes  Seldom  Never 


Comments : 


?.  Were  the  traffic  advisories  as  useful  as  current  ATC  traffic  advisories7 


More 

About 

Sel dom 

Never 

useful 

as  useful 

as  useful 

as  useful 

71% 

Comments : 


3.  How  did  the 

advisories  affect  your  workload 

as  compared 

to  current  ATC 

advi sories? 

Unacceptable 

Acceptable  No  effect 

Small 

Larae 

increase  in 

increase  in  on  workload 

decrease 

decrease 

workload 

workload 

in  workload 

in  workload 

64%  9% 

?J% 

Comments: 

4.  Do  you  feel  the  threat  display  would  help  you  locate  traffic  you  would 
not  normally  see’ 

Always  Usually  Sometimes  Seldom  Never 

18*  46%  37%  ___  __ _ 

Comments:  Possibility  of  mi  si  dent.-i  ficat.ion  exists 


6.  Do  you  feel  that  the  master  caution  alert  was  necessary  to  draw  your 
attention  to  the  threat  display7 

Always  Usually  Sometimes  Seldom  Never 

18%  6  4%  9%  9% 


Comments:  Do  not  need  three  levels,  visual  and  aural  should  come  oN  at  the 
same  time 


8.  Was  the  graphic  format  clear  and  unambiguous? 

Always  Usually  Sometimes  Seldom  Never 

86%  ?7%  _  _ 

Prediction  vector  added  unnecessary  clutter _ 


Comments : 


7.  Was  there  too  much  or  too  little  information  orovideri  by  the  qraphic 
format.’ 

About  riqht  01?, 

Add  the  following:  Q%  instrurier's  speed 


Delete  the  following: 

i  _ 

Comments: 


R. 


Were  you  able 

A1  ways 
ox 


to  read  the  tabular  information  fast  enough’ 

Usually  Sometimes  Seldom  Never 

26*  64% 


Comments : 


o.  Were  you  able  to  use  the  tabular  data  to  anticipate  the  evasive  maneuver’ 

Always  Usually  Sometimes  Seldom  Never 

64?  36% 


Comments : 


In  the  space  below  please  describe  any  difficulties  you  had  durinq  the  fliqht 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  qive  any  overall 
conments  on  the  TCAS  display(sl  and  information  presentation. 
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POST -FLIGHT  fHiESTIONMAIRE  (TABULAR  WITHOUT  REARING) 


Please  complete  the  following  questions  with  respect  to  the  TCAS  configuration 
that  you  flew  with  on  your  last  fliqht.  Use  the  Comments  section  freely  since 
your  input  is  important  to  the  development  of  useful  recommendations.  Also 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TCAS  configuration. 

Pilot: _ Gate: 

TCAS  Contiauration; 


1.  Were  the  traffic  advisories  presented  in  time  to  he  effectively  used? 
Always  Often  Sometimes  Seldom  Never 


Always  Often 

4St  W 


Sometimes  Seldom 
to* 


3. 


How  did  the  advisories  affect,  your  workload  as  compared  to  current 
ATC  advisories? 


Unaccept.abl  e 

Acceptable 

No  effect 

Small 

Larqe 

increase  in 

increase  in 

on  workload 

decrease 

decrease 

workload 

work! oad 

in  workload 

in  workload 

27% 

64% 

0% 

Comments:  Too  much  interpretation,  multiple  alerts  impossible 


4.  Oo  you  feel  the  threat  display  would  help  you  locate  traffic  you 

would  not  normally  see? 


A1  ways 

Usually 

Sometimes 

Ql% 

Sel dom 

0% 

Never 

Comments : 

5.  Do  you  feel  that  the  master  caution  alert,  was  necessary  to  draw  your 

attention  t.o  the  threat  display? 

Always  Usually  Sometimes  Seldom  Never 

36%  46%  D%  _  0% 

Comments:  Chime  is  inadquat.e _ 


Did  the 

tabular  data 

provide  a  clear 

and  unambiguous 

representation 

of  the 

threat? 

A1  ways 

Usually 

Sometimes 

Sel  dom 

Never 

q% 

36% 

q% 

36% 

Comments :  Too  hard  to  "picture"  where  the  traffic  is.  Colors  were  more 
important  than  the  actual  data  _ 


/ 


Was  there  too  much  or  too  little  information  provided  by  the  tabular 
format? 


About  riqht  71% 

Add  the  fol  1  owi nq :  73**  add  bearing 

f)el  ete  the  fol  1  owi  nq : 

Comments:  Do  not  like  update  rate _ 


A.  Were  you  able  to  read  the  t.ahui  ar  information  fast  enouqh’ 

Always  Usually  Sometimes  Seldom  Uever 

sa?,  71%  <n  ot 


Comments : 


0.  Were  you  able  to  use  the  tabular  data  to  an^icinate  the  evasive 

maneuver’ 

Always  Usually  Sometimes  Seldom  Never 

71%  18?,  Sfl” 

Comments:  Especially  difficult  with  multiple  intruders  _ _ 
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In  the  space  below  please  describe  any  difficulties  you  had  during  the  fl 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  give  any  overall 
comments  on  the  TCAS  display(s)  and  information  presentation. 


POST-FLIGHT  QUESTIONNAIRE  (TABULAR  WITH  BEARING) 

Please  complete  the  following  questions  with  respect  to  the  TCAS  configuration 
that  you  flew  with  on  your  last  flight.  Use  the  Comments  section  freely  since 
your  input  is  important  to  the  development  of  useful  recommendations.  A1  so 
use  the  Comments  section  to  enumerate  any  operational  difficulties  you  foresee 
with  this  TCAS  configuration. 

Pilot: _ Date: _ 

BCAS  Configuration:  _  _ 


1.  Were  the  traffic  advisories  presented  in  time  to  he  effectively  used? 

Always  Usually  Sometimes  Seldom  Never 

5S%  36%  P% 


Comments:  Multiple  intruders  difficult 


Were  the  traffic 

advisories  as  useful 

as  current 

ATC  traffic 

advisories? 

More 

About 

Sel  dom 

Never 

useful 

as  useful 

as  usofui 

as  useful 

18% 

73% 

8% 

Consents: 
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3. 


How  Hid  t.he  advisories  affect  your  workload  as  compared  to  current 
ATC  advisories? 


Unacceptable  Acceptable  No  effect 

increase  in  increase  in  on  workload 
workload  workload 

27%  64%  _ 

Comments:  Time  consuming  interpretation _ 


Small  La roe 

decrease  decrease 

In  workload  in  workload 
0% 


4. 

Do  you 

feel  the  threat 

display  would 

help  you 

locate  traffic 

woul  d 

not  normally  see’ 

Always 

Usually 

Sometimes 

Sel dom 

Never 

64% 

27% 

18% 

Comments : 


6.  Do  you  Teel  that  the  master  caution  alert  was  necessary  to  draw  your 

attention  to  the  threat  display? 

Always  Usually  Sometimes  Seldom  Never 

66%  27%  18%  _  _ 

Comments :  _ 


6.  Did  the  tabular  data  provide  a  clear  and  unamhiquous  representation 

of  the  threat? 


A1 ways 

Usually 

Sometimes 

Sel dom 

Never 

8% 

36% 

46% 

8% 

Comments : 

7. 


Was  there  too  much  or  too  little  information  provided  by  the  qraphic 
format? 


About  riqht  91% 

Add  thp  followinq:  0%  direction  of  intruder  vertical  motion 

Delete  the  f ol 1 owi nq : _ 

Comments:  Multiple  intruders  could  not,  be  understood 


8. 


Were  you  able  to  read  the  tabular  information  fast  enouqh? 
Always  Usually  Sometimes  Seldom  Never 

8%  71%  64% 


Comments : 


9.  Were  you  able  to  use  the  tabular  data  to  anticipate  the  evasive 

maneuver? 

Always  Usually  Sometimes  Seldom  Never 

_  64%  86%  _  _ 

Comments: 


In  the  space  below  please  describe  any  difficulties  you  had  during  the  fllqht 
and/or  with  the  TCAS  equipment.  Also  use  the  space  to  qlve  any  overall 
comments  on  the  TCAS  dlsplay(s)  and  Information  presentation. 
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APPENDIX  D 


DEBRIEFING  OIIESTIONWMRF 


D-l 


Observer  No. 


TRAFFIC  ALERT  AND  COLLISION  AVOIDANCE  SYSTEM  (TCAS) 
FLIGHT  CREW  OIJESTIONNAIRE 


Name : _ 

Company: _ __  Aqe: 

Present  Position: _ Aircraft: 

Pilot  Certificate! si  Held: _ 

Total  Hours:  Past  Year: 


In  the  space  below,  identify  the  t.yoes  of  aircraft  you  have  flown.  Put  a  ] 
above  the  aircraft  tyoe  you  have  flown  most  recently,  a  ?  above  the  next,  and 
so  on. 


4 7%_  m%_  so% 

(B-707)  ( B-777 )  (B-777)  (B-747)  (DC-B)  (DC-O)  (DC-10)  L-101.1)  (Other) 

Do  you  reqularly  fly  into  TCA's? 

YES  100%  NO _ 

(approximately  _  times  a  year) 

(which  airports?  _  ) 

Were  you  familiar  with  the  TCAS  proqram  prior  to  your  solicitation  or 
se1ection  to  parti cioat.e  in  this  experiment.? 

YES  677, _  NO  17% _  VAGUELY  V%_ _ 

Comments  concerninq  TCAS: 


Please  complete  the  followinq  questionnaire,  answerinq  the  questions  with  your 
present  views  on  aircraft,  separation  in  qeneral  and  the  Traffic  Alert  and 


Collision  Avoidance  System  (TCAS)  specifically.  Althouqh  the  comments  are 
optional,  they  can  provide  a  valuable  contribution  to  the  test  prooram. 
Comments  may  he  used  to  expand  upon  or  qualify  your  initial  answer,  or  to  note 
that  the  question  is  not  framed  in  a  manner  which  allows  your  true  opinion  to 
be  expressed.  Therefore,  please  use  t.he  Comments  sections  liberally  to  ensure 
proper  interpretation  of  your  answers.  If  you  are  not  familiar  with  certain 
aspects  of  the  TCAS,  please  answer  the  question  and  indicate  in  the  Comments 
section  your  reservati ons .  If  you  comment  exceeds  the  soace  provided  olease 
continue  it  on  thP  hack  of  the  paqe  nr  on  a  separate  piece  of  paper  (be  sure 
to  number  the  continuation  with  the  question  number).  In  this  section  of  the 
questionnaire  there  are  two  types  of  questions:  The  first  is  multiple  choice 
in  which  you  should  select  the  answer  that  most  closely  matches  your  opinion. 
Secondly,  there  are  the  open-ended  questions  asking  for  a  written  response. 
Please  answer  these  completely.  Remember  there  is  no  right  or  wrong  answer; 
your  thoughts  are  important. 

1.  In  general,  do  )  u  feel  that  a  collision  avoidance  system  should  bp 
_  a.  Required  on  all  aircraft  immediately. 

75**.  h.  Required  on  all  aircraft  as  soon  as  it  can  be  implemented  and 

demonstrated  t.0  perform  rpliably. 

_  c.  Required  on  all  aircraft  in  the  terminal  area  only. 

d.  Rpgui red  on  all  aircraft  above  or  helow  certain  altitude 

(indicate  altitude  1. 

above  below 

R*  p.  Required  on  air  carrier  aircraft  only. 

PT  f.  Implemented  as  soon  as  it  can  he  tied  to  the  ATC  system  to  provide 

total  traffic  control . 
fit  g.  Not  required. 


Comments:  Used  as  a  back-up  for  ATC.  System  should  be  reliable,  economically 
reasonable  and  compatible  with  ATC. _ 
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2a.  Please  rank  all  the  display  conflqurat.lons  that  you  few  during  the  test 
(l  =  most  preferred  to  1  =  least  preferred. 

IVSI  AND  VOICE 
LED  AND  VOICE 
VOICE  ONLY 

2b.  Please  rank  all  the  threat  advisory  (TA)  display  formats  that  you  observed 
(1  =  most  preferred  to  A  =  least  preferred). 

None 

Precursor  Liqht 

Tabular  without  Anqle  of  Arrival 
Tabular  with  Anqle  of  Arrival 
Minimum  Graphic 
Advanced  Graphic 

2c.  Are  there  any  displays  or  formats  that  you  would  add?  If  so  please 
describe  them  and  qive  a  rank  relative  to  the  above. 


2d.  What,  display  or  combination  of  displays  would  you  like  t.o  see  used  by  the 
TCAS  system? 

TEAS  light,  plus  IVSI  (45%)  advanced  graphic  plus  IVSI  (55%)  could  use 
EADI  on  new  aircraft 


6 

2.6 

4.4 

1.2 

2.1 

1.6 


\ 

2 

3 


3a.  Rank  the  followinq  items  in  relative  importance  for  accurate  resolution  of 
a  conflict  (l  =  most  important,  13  =  least,  important). 


Rank  Check  if  the 

item  is  essential 


Altitude  of  other  aircraft  1 .ft 

He ad i no  of  other  aircraft  6. A 

Relative  bearinq  3.1 

Ranqe  of  other  aircraft  3.6 

Other  aircraft  type  16 .ft 

Vertical  speed  of  other  aircraft’  ft. 7 

Horizontal  closure  rate  6 .4 

Vertical  closure  rate  7 .6 

Closure  anqle  ft .7 

Other  aircraft  identify  17.1 

Projected  miss  distance  horizontal  ft .2 

Projected  miss  distance  vertical  ft. 5 

Direction  ot  miss  (e.q.,  passinq  to  left!  17.7 
Time  to  closest  avoroach  ft. 5 

Turninq/not  turninq  status  of  intruder  ft .5 

Whether  or  not.  the  intruder  is  TCAS  equi ppedl? .4 
Airspeed  of  intruder  U_ 

If  intruder  is  ATC  controlled  IP. A 


100% 

26% 

7  6% 
76% 


17% 

17% 

17% 


17% 

ft% 


Comments : 


3b.  Are  there  any  other  items  of  information  that  you  would  like  to  have  in  a 
conflict  situation?  If  so  please  describe  them  and  indicate  if  they  are 
essential . 


Direction  of  vertical  movement  (42%) 


4a.  Do  you  feel  that  both  corrective  (climb)  and  restrictive  (don't  descend) 
commands  are  necessary  or  useful? 

CORRECTIVE  RESTRICTIVE 

Unnecessary  _ _  25% _ 

Useful  R% _  £2% _ 

Necessary  92% _  T3% _ 

4b.  Do  you  feel  that  both  types  of  command  have  equal  operational 
critical  ity? 

Corrective  more  Both  the  Restrictive 

critical  same  criticality  more  critical 

67%  ??%  _ 

4c.  In  your  opinion,  what  is  the  best  presentation  format  for  the  corrective 
command  alerts  (e.g.,  alphanumeric,  arrows,  pictorial,  etc.)7 

Arrow  plus  voice  (100%)  _ _ _ _ _ 


4d.  What  is  the  best  presentation  format  for  restrictive  commands7 
Bars/vertical  SDeed  plus  voice  (92%),  voice  (B%) _ 


Comments:  All  guidance  should  be  positive 
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It  has  also  been  proposed  the  TCAS  use  “maintenance"  alerts  in  conjunc¬ 
tion  with  the  "command"  alerts.  Do  you  fepi  that  both  maintenance 
(maintain  climb  faster  than  lOHO  fpm)  and  coronand  alerts  are  necessary 
and  why? 

Yes  Mo 

6n  221 

Explain:  _ 


6.  In  qeneral ,  were  the  actions  indicated  by  the  commands  durinq  the  test 
fliqhts  clear  and  unambiquous7 

ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

25%  SR%  17% 


Comments: 


7.  Do  you  feel  that  the  commands  used  in  the  test  qave  you  sufficient,  time 
to  react? 


ALWAYS 

USUALLY 

SOMETIMES 

SELDOM 

NEVER 

42% 

Comments : 


8.  Did  you  agree  with  the  command  given? 


ALWAYS  USUALLY 


SOMETIMES 


SELDOM 


NEVER 


Comments :  When  a  pilot,  anticipates  the  command  and  it  is  different  he  will  be 
rel uctant. 


9a.  Did  the  display  and/or  command  cause  you  to  make  larqer  than  briefed 
f.?SG  excersion  to  1000  fpml  vertical  accelerations? 


ALWAYS 


USUALLY  SOMETIMES  SELDOM  NEVER 


Comments:  Should  have  a  motion  base  or  a  0  meter 


9b.  What  changes  in  format  should  be  made  to  the  IVSI  to  improve  system 
performance? 

Lights  are  too  bright,  add  horizontal  arrows,  indicate  required  climb 
rate 


9c.  What  changes  should  be  made  in  the  LED  display7 


Too  busy,  move  to  qlareshield 


9d.  What  changes  should  be  made  in  the  voice7 


Clarify  limit  command 
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in.  Does  the  modification  of  the  I  VS  1  by  addition  of  command  tiqhts  detract, 
from  the  primary  purpose  of  the  instrument7 

YES  NO 

R%  <m 

Comments : 


11a.  Does  the  use  of  color  on  the  conriand  display  help  in  interpreting  the 
information  presented7 


VERY  MUCH  SOME  VERY  LITTLE 

67%  ?S% 


NONE 

R% 


Comments : 


12a.  There  have  been  two  ways  defined  to  present  the  horizontal  separation 

between  your  aircraft  and  an  intruder.  The  first  is  by  time  (TAU)  which 
takes  into  account  not  only  ranqe  but.  also  closure  rate.  The  second  is 
the  actual  ranqe  (distance  to  the  intruder).  Which  information  would  you 
prefer? 


Time  Ranne  No  Preference  Other 

4?',r  42%  17% 

12h.  Was  the  scale  used  in  the  test  satisfactory? 

Very  Satisfactory  Rorderline  Unsatisfactory 

Sati sfactory 

R%  67%  ?S% 


Very 

IJnsati  sfactory 


Comments:  Combine  both  time  and  ranqe 


13.  The  current  collision  avoidance  system  prescribes  only  vertical  evasive 
maneuvers.  If  techno! oqy  would  permit,  do  you  feel  that,  horizontal 
maneuver  should  also  be  included  and  If  so  when  would  they  be  most  useful 
-  e.q.,  where  and  what  speeds  etc.? 

YES  d?t  NO 

Comments:  Avoid  altitude  crosses,  when  vertical  change  is  inappropriate  when 
given  a  hard  altitude,  in  high  density  _ 


14.  Since  the  present  system  provides  only  vertical  resolution  advisory 
commands,  how  useful  is  the  inclusion  of  vertical  speed  on  the  TCAS 


Command  Di spl ay? 

Extremely  Useful 

Of  No 

Detrimental 

Extremely 

Useful 

Use 

Detrimental 

?3t  SOt 

17t 

Comments:  Will  he  part  of  the  maneuver  so  should  be  located  in  the  same  place'* 


IS.  Do  you  feel  that,  the  master  visual  warning  was  needed  in  addition  to 
the  master  aural  to  draw  your  attention  to  the  TCAS  alerts'* 

ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

SOt,  fit  fit  fit 


?5t 

Comments: 


16.  How  well  do  you  feel  the  master  aircraft  aural  alert  drew  your  attention 
to  the  TCAS  alerts? 


Excel  1  ent. 

Good 

Fair 

Poor 

Unacceptabl e 

Not 

No  Chanqes 

Mi  nor 

Mi  nor 

Ma.ior 

Maior  Chanqes 

Needed 

3  ST 

Chanqes 

Beneficial 

SR7 

Chanqes 

Recommended 

Chanqes 

Recommended 

R% 

Requi red 

Comments:  TCAS  light  very  heneficial,  aural  must  coincide  with  the  visual 


17.  Are  hoth  a  master  aural  and  master  visual  needed  to  ensure  TCAS  alert 

detection  under  all  environmental  conditions  (noise,  lioht,  decompression, 
etc.)  on  the  flight  deck’ 

yes  fm  Nn  m 

Comments : 


IRa.  In  addition  to  the  conmand  alerts  (RA)  do  you  fpel  that  some  form  of 
caution  alert  (traffic  advisory),  which  would  prpceed  most  RAs,  would 
henefit  TCAS7 


VERY 

SOME 

VERY 

NONE 

MUCH 

LITTLE 

677 

337. 

IRb.  If  you  feel  these  would  he  a  benefit  please  explain. 

Takes  startle  effect,  away,  prepares  crew  for  possible  action.  Builds 
anal oqical  sequence. _ _ _ _ 


18c.  What  elements  would  have  to  be  added  to  the  traffic  advisory  to  make  it 
an  essential  part  of  the  system? 

None  (light  only),  more  time. _ 


Ifld.  What  traffic  should  be  displayed  on  the  threat,  display  (TAl? 

33%  Only  threats  as  defined  by  the  TCAS  alqorithms. 

33%  TCAS  threats  with  an  notion  to  display  surroundinq  traffic. 

33%  TCAS  threats  with  surroundinq  traffic  displayed  automatically 
when  a  threat,  is  present. 

_  All  surroundinq  traffic  displayed  with  some  filt.erinq  loqic 

used  to  reduce  the  number. 

_  All  surroundinq  traffic  displayed. 

Others  -  explain. 


1*1.  If  the  traffic  advisories  (TA)  contain  only  altitude  and  ranqe  informa¬ 
tion  of  the  threat  aircraft,  would  they  still  he  considered  an  essential 
part  of  a  TCAS’ 


SOME 

17% 


NONE 


Comments: 


VERY 

MUCH 

33% 


VERY 

LITTLE 

17% 


33% 


?0a.  How  useful  <1o  you  feel  the  TCAS  threat  disolay  will  he  in  each  fliqht 
Dhase? 


Very  Moderately  Not 

Useful  Useful  Useful  Undesirable 


Takeoff 

Cl  imb 

SR* 

Crui se 

SR* 

Descent 

SR* 

Approach 

SR* 

Landi nq 

R* 

Comments : 

SO* 

17* 

31* 

17* 

R* 

17* 

ft* 

17* 

17* 

17* 

R* 

17* 

ft* 

17* 

17* 

SO* 

ft* 

33* 

?0b.  Durinq  the  test  fliqhts  you  saw  both  tabular  and  qraphic  formats  for  the 
visual  threat  display,  do  you  feel  that  the  format  will  have  an  effect 
on  the  displays  utilization  with  respect  to  fliqht  phase?  If  so  olease 
explain. 

Graphic  best  ( 100% 1 ,  nei ther  is  too  useful  (42*1 _ 


21.  In  the  test  fliqhts  were  the  traffic  advisories  presented  in  time  to  be 
useful? 

ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

42*  SR* 


Comments : 


r 


22.  What  Is  the  maximum  number  of  traffic  advisories  that  you  believe  you 
could  monitor  simultaneously  while  at.tendlnq  fllqht  duties’  _ 

Comments:  As  few  as  possible _ 


23.  How  helpful  was  the  intruder's  anqle  of  arrival  (AOA)  or  hearinq  in  us^na 
the  traffic  advisory  alerts’ 


Excel  1 ent 

Good 

Fai  r 

Poor 

Unacceptable 

Not 

No  Chanoes 

Minor 

Minor 

Ma.ior 

Ma.ior  Chanqes 

Needed 

Chanqes 

Chanqes 

Chanqes 

Required 

Beneficial 

Recommended 

Recommended 

W*, 

25% 

in 

Explain:  Will 

let  you  know  when  visual 

acqui  st.iion 

is  not  possible 

24.  What  type  of  presentation  do  you  feel  was  most  appropriate  for  the 
traffic  advisories?  (Please  rank  1  =  most,  7  =  least.) 


None  Precursor 

Tabu! ar 

Tabul ar 

Minimum 

Advanced 

Both 

1  iqht 

wi thout 

wi  th 

qraphics 

qraphics 

tabu! ar 

anqle-of- 

anql e-of- 

and 

arri val 

arri val 

qraphics 

7  3/5 

S.1 

4.1 

2.2 

1.4 

4.7 

Comments : 


?*>.  When  all  factors  are  considered,  how  would  you  describe  the  value  of  TA 
with  bearing  compared  to  TA's  wi t.hotjt  bearinq? 

Q2%  Much  better  with  bearinq 
Bt  Better  with  bearinq 

_  About  the  samp  -  pro's  and  con's  balance 

_ Less  valuable  with  bearinq 

_ Much  less  valuable  -  bearinq  is  detrimental 

Comments : 


?6.  Were  the  traffic  advisories  as  useful  as  verbal  advisories  from  ATC? 


MUCH  MORE 

MORE 

ABOUT  AS 

SELDOM  AS 

NEVER  AS 

USEFUL 

USEFUL 

USEFUL 

USEFUL 

USEFUL 

ot 

SOT 

OT 

2OT 

Comments: 


21.  Did  the  use  of  colors  on  a  threat  display  (Red  for  resolution  alerts 
(warnings),  amber  for  traffic  advisories  (caution)  and  Blue  for  a 
proximate  advisory)  help  you  in  interpretinn  the  threat  information? 

Very  much  Some  Very  little  None 

«3%  17* 


Comments:  Particularly  at  transition  points 


28a.  Should  the  altitude  of  the  Intruder  aircraft  he  given  and  If  so  in  what 
form? 


Altitude  Information 

MSL 

Relative  to 

not.  Required 

7.5% 

own  A1 ti tude 

7S% 

?8b.  In  what  intervals  should  the  altitude  information  be  given? 


a. 

one  foot 

b. 

ten  foot 

c. 

hundred  foot 

8?% 

d. 

thousand  foot 

8% 

Comments : 


28.  Durinq  the  test  fliqhts  were  you  able  to  visually  acquire  the  intruder 
aircraft  by  correlatino  it  (them!  with  the  advisory  present? 


ALWAYS  USUALLY  SOMETIMES  SELDOM 


Comments: Never  saw  the  intruder 


NEVER 

inm 


30a.  Do  you  feel  that  the  master  caution  alert  was  necessary  to  draw  your 
attention  to  the  traffic  advisories? 


ALWAYS 

USUALLY 

SOMETIMES 

SELDOM 

NEVER 

8% 

67% 

17% 

8% 

Comments : 
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30b.  Do  you  feel  that  this  feature  of  the  master  caution  is  desirable? 


ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

42%  33%  ?s%  __  _ 

Comments :  Concerned  with  high  density  activation  too  frequently 


30.  Were  you  able  to  use  the  traffic  advisory  information  to  anticipate  the 
direction  of  the  evasive  maneuver? 


ALWAYS  USUALLY 

SOMETIMES 

SELDOM 

NEVER 

58% 

25% 

8% 

8% 

Comments: 


31.  In  general  what  do  you  feel  about  the  amount  of  information  provided  by 
the  threat  display  { PW 13? 

75%  about  riaht 

10%  too  little,  add  to  the  following  critical  movement  of  intruder _ 

8%  too  much,  delete  the  following  _ _ 


Comments: 


32a.  During  the  test,  the  Intruder  aircraft  symbol  on  the  threat  display  went 
away  when  the  threat  was  resolved.  How  useful  would  It  be  If  the  disc! ay 
remained  active  after  your  maneuver  t.o  show  where  the  target  aircraft, 
went? 


Extremely 

Useful 

Of  No 

Detrimental 

Extremely 

Useful 

Use 

Detrimental 

17% 

17% 

67% 

32b.  If  you  feel  that  a  delay  would  be  useful,  how  lonq  should  the  tarqet. 
remain  on  the  screen7  Pilot  option,  as  long  as  it  is  In  range,  5-10 
seconds 


Comments : 


32c.  Do  you  feel  that  pilots  with  automated  threat  advisories  will  become 
complacent  and  devote  insufficient  time  to  visual  scanninq  for  non¬ 
transponder  equipped  aircraft? 


ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

50  17  17  17 

Conments:  Significant  challanqe  in  crew  training _ 


33.  Assuming  you  have  a  command  display  for  warninqs  and  a  threat  display 
with  bearinq  information,  will  you  he  concerned  about  maneuvering  into 
other  traffic  durinq  the  escape  maneuver? 

ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

25%  R%  33%  33* 


Comments : 


34a.  If  a  pilot  visually  acquires  the  aircraft  which  he  believes  is  causinq  an 
RA  can  you  think  of  any  situations  which  would  result  in  the  plot  con¬ 
cluding  that  the  RA  is  unnecessary’  If  so  what  are  they? 


System  unreliability  acquire  the  wrong  target,  parallel  approach 
holding  pattern,  visual  illusions _ 


34b.  Would  the  pilot  be  justified  in  not  following  the  RA  in  these  situations’ 
Why  or  why  not?  No  (67%)  Only  if  he  can  be  sure  it  is  false,  if  he 
elects  to  use  a  horizontal  maneuver,  crews  should  be  trained  to  follow 
the  RA 


34c.  What  influence  does  the  type  of  TA  service  beinq  provided  have  on  your 
responses  to  these  questions? 

None  -  an  RA  command  is  a  command,  must  be  reliable,  with  graphics  pilot. 
may  have  more  confidence  in  the  RA _ 


is.  no  you  feel  that  knowinq  the  intruders  position  (altitude,  ranqe  and 

approximate  bearinol  with  a  traffic  advisory  would  provide  enouqh  advance 
information  to  allow  you  to  minimize  the  anticipated  deviation  from  your 
planned  fliqht  path? 

ALWAYS  USUALLY  SOMETIMES  SELDOM  NEVER 

R*  SO*  3?%  R* 


Comments : 


36.  Do  you  feel  that  knowing  the  intruders  position  (altitude,  range  and 
approximate  bearinq)  with  a  traffic  advisory  would  provide  enouqh 
Information  for  you  to  beqln  makinq  minor  course,  speed  or  altitude 
changes  BEFORE  makinq  visual  contact  to  avoid  getting  a  maneuver  command7 


ALWAYS 

USUALLY 

SOMETIMES 

SELDOM 

NEVER 

33% 

S8% 

8% 

_ 

Conments:  Also  need  heading 


37.  What  effect  would  the  TCAS  have  on  your  confidence  when  overflying/ 
underflyinq  another  aircraft  by  1000  feet.? 


INCREASE  CONFIDENCE  NO  CHANGE  LESS  CONFIDENCE 

67%  33% 


Comments:  If  it  works,  if  it  is  wrong  one  time  confidence  is  gone 


38a.  Do  you  feel  that  use  of  TCAS  could  allow  reduced  vertical  traPfffic 
separation? 


MUCH 

REDUCED 


SOMEWHAT 

REDUCED 

?S% 


NO 

REDUCTION 

7S% 


INCREASED 

SEPARATION 


Comments:  Only  above  FL  PRO 


3Rb.  Reduced  Horizontal  Traffice  Separation? 


MUCH 

REDUCF.O 

SOMEWHAT 

REDUCED 

NO 

REDUCTION 

INCREASED 

SEPARATION 

33% 

67% 

3d.  Do  you  feel  that  the  TCAS  will  result  in  more  or  less  communication  with 
ATC7 

MUCH  LESS  SOMEWHAT  LESS  NO  CHANGE  SOMEWHAT  MORE  MUCH  MORE 
R%  33%  V%  4?% 


Comments : 


40.  Do  you  feel  that  a  reliable  TCAS  will  result  in  safer  ODerations  in 
respect  to  midair  collisions? 

MUCH  SOMEWHAT  NO  CHANGE  SOMEWHAT  MUCH  LESS 

SAFER  SAFER  LESS  SAFE  SAFE 

5R%  42% 


Comments:  Key  is  reliability,  probably  to  the  same  extent  that  GPWS  prevents 
collision  with  the  around 


41.  What  chanqes  would  be  required  in  aircraft  and  ATC  operatinq  procedures 
if  TCAS  were  implemented? 

Comments :  RAs  should  be  automatically  transmitted,  who  has  priority  on 
conflicting  information  between  alert  and  ATC,  ATC  should  not  rely  on  TCAS, 
Emergency  authority  to  break  clearance _ 
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SEMANTIC  DIFFERENTIAL  INSTRUCTIONS 

The  semantic  differential  qlves  us  a  way  to  judqe  pilot  opinions  of  the  TCAS 
in  a  systematic  fashion.  You  can  help  by  checkinq  the  deqree  to  which  your 
opinion  falls  between  each  of  these  21  adjective  pairs. 


An  examp1''  may  help.  Suppose  we  ask  you  to  iudoe  "politics"  on  the  foliowinq 
scale: 


GOnn 


I  I  I  I  I  I  |M» 


If  you  feel  that  politics  are  very  qood,  then  you  should  check  the  box  nearest 
that  adjective.  If  you  feel  that  politics  are  bad,  then  your  check  mark 
should  be  in  one  of  the  riqht-hand  boxes.  If  your  opinion  is  neutral,  neither 
positive  nor  neqative,  check  the  center  box. 


There  are  no  "riqht"  or  "wronq"  answers;  we  are  simply  askinq  your  opinion. 
Don't  be  hesitant  to  check  the  far  left  or  far  riqht  boxes  if  you  feel 
stronqly  about  the  concept.  It's  better  that  you  don't  chanqe  a  check  mark 
once  it  is  madp;  your  first  opinion  may  be  most  valid. 

Both  positive  and  neqative  adjectives  may  appear  on  either  riqht  or  left, 
sides,  so  consider  each  pair  carefully  before  you  make  the  check  mark. 
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Using  the  following  descriptors,  judge  the  TCAS  I VSI  command  display  and  its 
operational  uses  as  you  currently  know  them. 


CLEAR 

DEMANDING 

LIMITED 

DESIRABLE 

UNTRUSTWORTHY 

COMPLEX 

ASSISTANCE 

VALUABLE 

NONESSENTIAL 

COMPLETE 

NATURAL 

EASY 

HAZARDOUS 

TIMELY 

UNACCEPTABLE 

UNBURDENING 

STARTLING 

INFORMATIVE 

INDISTINCTIVE 

RELIABLE 

ACCURATE 


CONFUSING 

UNDEMANDING 

VERSATILE 

UNDESIRABLE 

TRUSTWORTHY 

SIMPLE 

HINDRANCE 

WORTHLESS 

ESSENTIAL 

INCOMPLETE 

UNNATURAL 

DIFFICULT 

SAFE 

UNTIMELY 

ACCEPTABLE 

BURDENING 

UNOBTRUSIVE 

UNINFORMATIVE 

DISTINCTIVE 

UNRELIABLE 

INACCURATE 
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Using  tha  following  descriptors,  judge  ths  TCAS  LEO  command  display  and  its 
operational  uses  as  you  currently  know  them. 


CLEAR 

DEMANDING 

LIMITED 

DESIRABLE 

UNTRUSTWORTHY 

COMPLEX 

ASSISTANCE 

VALUABLE 

NONESSENTIAL 

COMPLETE 

NATURAL 

EASY 

HAZARDOUS 

TIMELY 

UNACCEPTABLE 

UNBURDENING 

STARTLING 

INFORMATIVE 

INDISTINCTIVE 

RELIABLE 

ACCURATE 


CONFUSING 

UNDEMANDING 

VERSATILE 

UNDESIRABLE 

TRUSTWORTHY 

SIMPLE 

HINDRANCE 

WORTHLESS 

ESSENTIAL 

INCOMPLETE 

UNNATURAL 

DIFFICULT 

SAFE 

UNTIMELY 

ACCEPTABLE 

BURDENING 

UNOBTRUSIVE 

UNINFORMATIVE 

DISTINCTIVE 

UNRELIABLE 

INACCURATE 
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Usng  the  following  descriptors,  judge  the  TCAS  voice  commend  display  and  its 
op*  rational  uses  as  you  currently  know  them. 


CLEAR 

DEMANDING 

LIMITED 

DESIRABLE 

UNTRUSTWORTHY 

COMPLEX 

ASSISTANCE 

VALUABLE 

NONESSENTIAL 

COMPLETE 

NATURAL 

EASY 

HAZARDOUS 

TIMELY 

UNACCEPTABLE 

UNBURDENING 

STARTLING 

INFORMATIVE 

INDISTINCTIVE 

RELIABLE 

ACCURATE 


CONFUSING 

UNDEMANDING 

VERSATILE 

UNDESIRABLE 

TRUSTWORTHY 

SIMPLE 

HINDRANCE 

WORTHLESS 

ESSENTIAL 

INCOMPLETE 

UNNATURAL 

DIFFICULT 

SAFE 

UNTIMELY 

ACCEPTABLE 

BURDENING 

UNOBTRUSIVE 

UNINFORMATIVE 

DISTINCTIVE 

UNRELIABLE 

INACCURATE 


i 
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Using  the  following  descriptors,  judge  the  TCAS  tabular  display  and  its 
operational  uses  as  you  currently  know  them. 


CLEAR 

DEMANDING 

LIMITED 

DESIRABLE 

UNTRUSTWORTHY 

COMPLEX 

ASSISTANCE 

VALUABLE 

NONESSENTIAL 

COMPLETE 

NATURAL 

EASY 

HAZARDOUS 

TIMELY 

UNACCEPTABLE 

UNBURDENING 

STARTLING 

INFORMATIVE 

INDISTINCTIVE 

RELIABLE 

ACCURATE 


CONFUSING 

UNDEMANDING 

VERSATILE 

UNDESIRABLE 

TRUSTWORTHY 

SIMPLE 

HINDRANCE 

WORTHLESS 

ESSENTIAL 

INCOMPLETE 

UNNATURAL 

DIFFICULT 

SAFE 

UNTIMELY 

ACCEPTABLE 

BURDENING 

UNOBTRUSIVE 

UNINFORMATIVE 

DISTINCTIVE 

UNRELIABLE 

INACCURATE 
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Using  the  following  descriptor,  judge  the  TCAS  graphic  (minimum) 
display  and  its  operational  uses  as  you  currently  know  them. 


CLEAR 

DEMANDING 

LIMITED 

DESIRABLE 

UNTRUSTWORTHY 

COMPLEX 

ASSISTANCE 

VALUABLE 

NONESSENTIAL 

COMPLETE 

NATURAL 

EASY 

HAZARDOUS 

TIMELY 

UNACCEPTABLE 

UNBURDENING 

STARTLING 

INFORMATIVE 

INDISTINCTIVE 

RELIABLE 

ACCURATE 


CONFUSING 

UNDEMANDING 

VERSATILE 

UNDESIRABLE 

TRUSTWORTHY 

SIMPLE 

HINDRANCE 

WORTHLESS 

ESSENTIAL 

INCOMPLETE 

UNNATURAL 

DIFFICULT 

SAFE 

UNTIMELY 

ACCEPTABLE 

BURDENING 

UNOBTRUSIVE 

UNINFORMATIVE 

DISTINCTIVE 

UNRELIABLE 

INACCURATE 
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Using  the  following  descriptors,  judge  the  TCAS  grephic  (edvenced) 
display  end  its  operstionel  uses  es  you  currently  know  them. 


CLEAR 

DEMANDING 

LIMITED 

DESIRABLE 

UNTRUSTWORTHY 

COMPLEX 

ASSISTANCE 

VALUABLE 

NONESSENTIAL 

COMPLETE 

NATURAL 

EASY 

HAZARDOUS 

TIMELY 

UNACCEPTABLE 

UNBURDENING 

STARTLING 

INFORMATIVE 

INDISTINCTIVE 

RELIABLE 

ACCURATE 


CONFUSING 

UNDEMANDING 

VERSATILE 

UNDESIRABLE 

TRUSTWORTHY 

SIMPLE 

HINDRANCE 

WORTHLESS 

ESSENTIAL 

INCOMPLETE 

UNNATURAL 

DIFFICULT 

SAFE 

UNTIMELY 

ACCEPTABLE 

BURDENING 

UNOBTRUSIVE 

UNINFORMATIVE 

DISTINCTIVE 

UNRELIABLE 

INACCURATE 
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SYSTEM  DISPLAY  DESIGN 


In  the  followinq  space  please  desiqn  the  TCAS  display!  si  that  you  would  put. 
into  the  fliqht,  deck.  Desiqn  a  command  display  for  a  conventional  and  one  for 
an  electronic  fliqht  deck.  Provided  for  your  information  are  t he  alerts  which 
this  display  must  present,  at  a  minimum.  Alonq  with  your  desiqn  pleas°  qive 
the  location  of  the  display  in  the  instrument  panel.  Then  desion  the 
information  presentation  that  you  would  like  to  see  on  the  threat  display. 
Aqain  please  describe  its  location.  Use  the  back  side  of  the  papers  to 
continue  your  display  description  if  you  require  more  space. 

In  order  to  standardize  the  responses  to  this  section  of  the  questionnai re  it 
will  be  necessary  to  use  the  smae  prescribed  alert  situations  and  the  same 
scenarios  to  illustrate  your  recommended  t.hreat/di spl ay  relationship.  We  win 
consider  two  situations,  one  requirinq  a  vertical  command  and  one  reouirinq  a 
limit  command. 

(1)  Vertical  Command 

(a)  Scenario:  Own  aircraft,  is  straiqht  and  levpl  at  .TOO  kts  at  1SOOO 
ft.  Jhreat  alert  aircraft  is  cominq  from  10  o'clock  position  and  is 
initally  2000  ft  below  and  ft  nmi  away.  This  results  in  a  closure 
rate  of  ARO  knots.  The  threat  is  climbinq  such  that.  it.  will  collide 
which  qives  a  climb  rate  of  about  2600  fnm.  The  total  lenath  of 
time  from  start,  to  potential  collision  is  AS  seconds. 

(bl  Command:  The  vertical  resolution  advisinq  command  will  he  a  climb 
command  with  a  desired  1/A  G  pull  up  to  1000  fpm  rate  of  climb. 

(2)  Limit  Command 

(a)  Scenario:  Own  aircraft  is  straiqht.  and  descendinq  at  2000  fpm,  2S0 
kts,  passinq  10000  ft.  Threat  aircraft,  is  cominq  from  2  o'clock,  it 
is  at  your  altitude  and  also  descendinq  at.  2000  fpm.  Aqain,  you  are 
on  collision  traiectorips,  AS  seconds  from  impact.  Assume  a  closure 
rate  of  200  kts  which  places  you  initially  at  ?.*>  miles  apart. 
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(b)  Command:  Assume  you  are  both  TCAS  equipped  and  received  complemen 
tary  commands.  He  is  commanded  t.o  descend.  Your  command  is  t.o 
Limit.  Descent  to  500  fpm.  The  proposed  maneuver  would  aqain  be  a 
1/4  G  pull  up. 
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